Ten quick tips for computational analysis of medical images.

Medical imaging is a great asset for modern medicine, since it allows physicians to spatially interrogate a disease site, resulting in precise intervention for diagnosis and treatment, and to observe particular aspect of patients' conditions that otherwise would not be noticeable. Computational analysis of medical images, moreover, can allow the discovery of disease patterns and correlations among cohorts of patients with the same disease, thus suggesting common causes or providing useful information for better therapies and cures. Machine learning and deep learning applied to medical images, in particular, have produced new, unprecedented results that can pave the way to advanced frontiers of medical discoveries. While computational analysis of medical images has become easier, however, the possibility to make mistakes or generate inflated or misleading results has become easier, too, hindering reproducibility and deployment. In this article, we provide ten quick tips to perform computational analysis of medical images avoiding common mistakes and pitfalls that we noticed in multiple studies in the past. We believe our ten guidelines, if taken into practice, can help the computational-medical imaging community to perform better scientific research that eventually can have a positive impact on the lives of patients worldwide.

Test-retest repeatability of a deep learning architecture in detecting and segmenting clinically significant prostate cancer on apparent diffusion coefficient (ADC) maps.

OBJECTIVES: To evaluate short-term test-retest repeatability of a deep learning architecture (U-Net) in slice- and lesion-level detection and segmentation of clinically significant prostate cancer (csPCa: Gleason grade group > 1) using diffusion-weighted imaging fitted with monoexponential function, ADCm. METHODS: One hundred twelve patients with prostate cancer (PCa) underwent 2 prostate MRI examinations on the same day. PCa areas were annotated using whole mount prostatectomy sections. Two U-Net-based convolutional neural networks were trained on three different ADCm b value settings for (a) slice- and (b) lesion-level detection and (c) segmentation of csPCa. Short-term test-retest repeatability was estimated using intra-class correlation coefficient (ICC(3,1)), proportionate agreement, and dice similarity coefficient (DSC). A 3-fold cross-validation was performed on training set (N = 78 patients) and evaluated for performance and repeatability on testing data (N = 34 patients). RESULTS: For the three ADCm b value settings, repeatability of mean ADCm of csPCa lesions was ICC(3,1) = 0.86-0.98. Two CNNs with U-Net-based architecture demonstrated ICC(3,1) in the range of 0.80-0.83, agreement of 66-72%, and DSC of 0.68-0.72 for slice- and lesion-level detection and segmentation of csPCa. Bland-Altman plots suggest that there is no systematic bias in agreement between inter-scan ground truth segmentation repeatability and segmentation repeatability of the networks. CONCLUSIONS: For the three ADCm b value settings, two CNNs with U-Net-based architecture were repeatable for the problem of detection of csPCa at the slice-level. The network repeatability in segmenting csPCa lesions is affected by inter-scan variability and ground truth segmentation repeatability and may thus improve with better inter-scan reproducibility. KEY POINTS: • For the three ADCm b value settings, two CNNs with U-Net-based architecture were repeatable for the problem of detection of csPCa at the slice-level. • The network repeatability in segmenting csPCa lesions is affected by inter-scan variability and ground truth segmentation repeatability and may thus improve with better inter-scan reproducibility.

T1 and T2 MR fingerprinting measurements of prostate cancer and prostatitis correlate with deep learning-derived estimates of epithelium, lumen, and stromal composition on corresponding whole mount histopathology.

OBJECTIVES: To explore the associations between T1 and T2 magnetic resonance fingerprinting (MRF) measurements and corresponding tissue compartment ratios (TCRs) on whole mount histopathology of prostate cancer (PCa) and prostatitis. MATERIALS AND METHODS: A retrospective, IRB-approved, HIPAA-compliant cohort consisting of 14 PCa patients who underwent 3 T multiparametric MRI along with T1 and T2 MRF maps prior to radical prostatectomy was used. Correspondences between whole mount specimens and MRI and MRF were manually established. Prostatitis, PCa, and normal peripheral zone (PZ) regions of interest (ROIs) on pathology were segmented for TCRs of epithelium, lumen, and stroma using two U-net deep learning models. Corresponding ROIs were mapped to T2-weighted MRI (T2w), apparent diffusion coefficient (ADC), and T1 and T2 MRF maps. Their correlations with TCRs were computed using Pearson's correlation coefficient (R). Statistically significant differences in means were assessed using one-way ANOVA. RESULTS: Statistically significant differences (p < 0.01) in means of TCRs and T1 and T2 MRF were observed between PCa, prostatitis, and normal PZ. A negative correlation was observed between T1 and T2 MRF and epithelium (R = - 0.38, - 0.44, p < 0.05) of PCa. T1 MRF was correlated in opposite directions with stroma of PCa and prostatitis (R = 0.35, - 0.44, p < 0.05). T2 MRF was positively correlated with lumen of PCa and prostatitis (R = 0.57, 0.46, p < 0.01). Mean T2 MRF showed significant differences (p < 0.01) between PCa and prostatitis across both transition zone (TZ) and PZ, while mean T1 MRF was significant (p = 0.02) in TZ. CONCLUSION: Significant associations between MRF (T1 in the TZ and T2 in the PZ) and tissue compartments on corresponding histopathology were observed. KEY POINTS: • Mean T2 MRF measurements and ADC within cancerous regions of interest dropped with increasing ISUP prognostic groups (IPG). • Mean T1 and T2 MRF measurements were significantly different (p < 0.001) across IPGs, prostatitis, and normal peripheral zone (NPZ). • T2 MRF showed stronger correlations in the peripheral zone, while T1 MRF showed stronger correlations in the transition zone with histopathology for prostate cancer.

Integrating pathomics with radiomics and genomics for cancer prognosis: A brief review.

In the last decade, the focus of computational pathology research community has shifted from replicating the pathological examination for diagnosis done by pathologists to unlocking and discovering "sub-visual" prognostic image cues from the histopathological image. While we are getting more knowledge and experience in digital pathology, the emerging goal is to integrate other-omics or modalities that will contribute for building a better prognostic assay. In this paper, we provide a brief review of representative works that focus on integrating pathomics with radiomics and genomics for cancer prognosis. It includes: correlation of pathomics and genomics; fusion of pathomics and genomics; fusion of pathomics and radiomics. We also present challenges, potential opportunities, and avenues for future work.

Repeatability of radiomics and machine learning for DWI: Short-term repeatability study of 112 patients with prostate cancer.

PURPOSE: To evaluate repeatability of prostate DWI-derived radiomics and machine learning methods for prostate cancer (PCa) characterization. METHODS: A total of 112 patients with diagnosed PCa underwent 2 prostate MRI examinations (Scan1 and Scan2) performed on the same day. DWI was performed using 12 b-values (0-2000 s/mm2 ), post-processed using kurtosis function, and PCa areas were annotated using whole mount prostatectomy sections. A total of 1694 radiomic features including Sobel, Kirch, Gradient, Zernike Moments, Gabor, Haralick, CoLIAGe, Haar wavelet coefficients, 3D analogue to Laws features, 2D contours, and corner detectors were calculated. Radiomics and 4 feature pruning methods (area under the receiver operator characteristic curve, maximum relevance minimum redundancy, Spearman's ρ, Wilcoxon rank-sum) were evaluated in terms of Scan1-Scan2 repeatability using intraclass correlation coefficient (ICC)(3,1). Classification performance for clinically significant and insignificant PCa with Gleason grade groups 1 versus >1 was evaluated by area under the receiver operator characteristic curve in unseen random 30% data split. RESULTS: The ICC(3,1) values for conventional radiomics and feature pruning methods were in the range of 0.28-0.90. The machine learning classifications varied between Scan1 and Scan2 with % of same class labels between Scan1 and Scan2 in the range of 61-81%. Surface-to-volume ratio and corner detector-based features were among the most represented features with high repeatability, ICC(3,1) >0.75, consistently high ranking using all 4 feature pruning methods, and classification performance with area under the receiver operator characteristic curve >0.70. CONCLUSION: Surface-to-volume ratio and corner detectors for prostate DWI led to good classification of unseen data and performed similarly in Scan1 and Scan2 in contrast to multiple conventional radiomic features.

Radiomic features from pretreatment biparametric MRI predict prostate cancer biochemical recurrence: Preliminary findings.

BACKGROUND: Radiomics or computer-extracted texture features derived from MRI have been shown to help quantitatively characterize prostate cancer (PCa). Radiomics have not been explored depth in the context of predicting biochemical recurrence (BCR) of PCa. PURPOSE: To identify a set of radiomic features derived from pretreatment biparametric MRI (bpMRI) that may be predictive of PCa BCR. STUDY TYPE: Retrospective. SUBJECTS: In all, 120 PCa patients from two institutions, I1 and I2 , partitioned into training set D1 (N = 70) from I1 and independent validation set D2 (N = 50) from I2 . All patients were followed for ≥3 years. SEQUENCE: 3T, T2 -weighted (T2 WI) and apparent diffusion coefficient (ADC) maps derived from diffusion-weighted sequences. ASSESSMENT: PCa regions of interest (ROIs) on T2 WI were annotated by two experienced radiologists. Radiomic features from bpMRI (T2 WI and ADC maps) were extracted from the ROIs. A machine-learning classifier (CBCR ) was trained with the best discriminating set of radiomic features to predict BCR (pBCR ). STATISTICAL TESTS: Wilcoxon rank-sum tests with P < 0.05 were considered statistically significant. Differences in BCR-free survival at 3 years using pBCR was assessed using the Kaplan-Meier method and compared with Gleason Score (GS), PSA, and PIRADS-v2. RESULTS: Distribution statistics of co-occurrence of local anisotropic gradient orientation (CoLlAGe) and Haralick features from T2 WI and ADC were associated with BCR (P < 0.05) on D1 . CBCR predictions resulted in a mean AUC = 0.84 on D1 and AUC = 0.73 on D2 . A significant difference in BCR-free survival between the predicted classes (BCR + and BCR-) was observed (P = 0.02) on D2 compared to those obtained from GS (P = 0.8), PSA (P = 0.93) and PIRADS-v2 (P = 0.23). DATA CONCLUSION: Radiomic features from pretreatment bpMRI can be predictive of PCa BCR after therapy and may help identify men who would benefit from adjuvant therapy. LEVEL OF EVIDENCE: 4 Technical Efficacy: Stage 5 J. Magn. Reson. Imaging 2018;48:1626-1636.

Radiomic features on MRI enable risk categorization of prostate cancer patients on active surveillance: Preliminary findings.

BACKGROUND: Radiomic analysis is defined as computationally extracting features from radiographic images for quantitatively characterizing disease patterns. There has been recent interest in examining the use of MRI for identifying prostate cancer (PCa) aggressiveness in patients on active surveillance (AS). PURPOSE: To evaluate the performance of MRI-based radiomic features in identifying the presence or absence of clinically significant PCa in AS patients. STUDY TYPE: Retrospective. SUBJECTS MODEL: MRI/TRUS (transperineal grid ultrasound) fusion-guided biopsy was performed for 56 PCa patients on AS who had undergone prebiopsy. FIELD STRENGTH/SEQUENCE: 3T, T2 -weighted (T2 w) and diffusion-weighted (DW) MRI. ASSESSMENT: A pathologist histopathologically defined the presence of clinically significant disease. A radiologist manually delineated lesions on T2 w-MRs. Then three radiologists assessed MRIs using PIRADS v2.0 guidelines. Tumors were categorized into four groups: MRI-negative-biopsy-negative (Group 1, N = 15), MRI-positive-biopsy-positive (Group 2, N = 16), MRI-negative-biopsy-positive (Group 3, N = 10), and MRI-positive-biopsy-negative (Group 4, N = 15). In all, 308 radiomic features (First-order statistics, Gabor, Laws Energy, and Haralick) were extracted from within the annotated lesions on T2 w images and apparent diffusion coefficient (ADC) maps. The top 10 features associated with clinically significant tumors were identified using minimum-redundancy-maximum-relevance and used to construct three machine-learning models that were independently evaluated for their ability to identify the presence and absence of clinically significant disease. STATISTICAL TESTS: Wilcoxon rank-sum tests with P < 0.05 considered statistically significant. RESULTS: Seven T2 w-based (First-order Statistics, Haralick, Laws, and Gabor) and three ADC-based radiomic features (Laws, Gradient and Sobel) exhibited statistically significant differences (P < 0.001) between malignant and normal regions in the training groups. The three constructed models yielded overall accuracy improvement of 33, 60, 80% and 30, 40, 60% for patients in testing groups, when compared to PIRADS v2.0 alone. DATA CONCLUSION: Radiomic features could help in identifying the presence and absence of clinically significant disease in AS patients when PIRADS v2.0 assessment on MRI contradicted pathology findings of MRI-TRUS prostate biopsies. LEVEL OF EVIDENCE: 3 Technical Efficacy: Stage 2 J. Magn. Reson. Imaging 2018.

Identifying and improving the "ground truth" of race in disparities research through improved EMR data reporting. A systematic review.

BACKGROUND: Studies about racial disparities in healthcare are increasing in quantity; however, they are subject to vast differences in definition, classification, and utilization of race/ethnicity data. Improved standardization of this information can strengthen conclusions drawn from studies using such data. The objective of this study is to examine how data related to race/ethnicity are recorded in research through examining articles on race/ethnicity health disparities and examine problems and solutions in data reporting that may impact overall data quality. METHODS: In this systematic review, Business Source Complete, Embase.com, IEEE Xplore, PubMed, Scopus and Web of Science Core Collection were searched for relevant articles published from 2000 to 2020. Search terms related to the concepts of electronic medical records, race/ethnicity, and data entry related to race/ethnicity were used. Exclusion criteria included articles not in the English language and those describing pediatric populations. Data were extracted from published articles. This review was organized and reported in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) 2020 statement for systematic reviews. FINDINGS: In this systematic review, 109 full text articles were reviewed. Weaknesses and possible solutions have been discussed in current literature, with the predominant problem and solution as follows: the electronic medical record (EMR) is vulnerable to inaccuracies and incompleteness in the methods that research staff collect this data; however, improved standardization of the collection and use of race data in patient care may help alleviate these inaccuracies. INTERPRETATION: Conclusions drawn from large datasets concerning peoples of certain race/ethnic groups should be made cautiously, and a careful review of the methodology of each publication should be considered prior to implementation in patient care.

An integrated radiology-pathology machine learning classifier for outcome prediction following radical prostatectomy: Preliminary findings.

Objectives: To evaluate the added benefit of integrating features from pre-treatment MRI (radiomics) and digitized post-surgical pathology slides (pathomics) in prostate cancer (PCa) patients for prognosticating outcomes post radical-prostatectomy (RP) including a) rising prostate specific antigen (PSA), and b) extraprostatic-extension (EPE). Methods: Multi-institutional data (N = 58) of PCa patients who underwent pre-treatment 3-T MRI prior to RP were included in this retrospective study. Radiomic and pathomic features were extracted from PCa regions on MRI and RP specimens delineated by expert clinicians. On training set (D1, N = 44), Cox Proportional-Hazards models MR, MP and MRaP were trained using radiomics, pathomics, and their combination, respectively, to prognosticate rising PSA (PSA > 0.03 ng/mL). Top features from MRaP were used to train a model to predict EPE on D1 and test on external dataset (D2, N = 14). C-index, Kalplan-Meier curves were used for survival analysis, and area under ROC (AUC) was used for EPE. MRaP was compared with the existing post-treatment risk-calculator, CAPRA (MC). Results: Patients had median follow-up of 34 months. MRaP (c-index = 0.685 ± 0.05) significantly outperformed MR (c-index = 0.646 ± 0.05), MP (c-index = 0.631 ± 0.06) and MC (c-index = 0.601 ± 0.071) (p < 0.0001). Cross-validated Kaplan-Meier curves showed significant separation among risk groups for rising PSA for MRaP (p < 0.005, Hazard Ratio (HR) = 11.36) as compared to MR (p = 0.64, HR = 1.33), MP (p = 0.19, HR = 2.82) and MC (p = 0.10, HR = 3.05). Integrated radio-pathomic model MRaP (AUC = 0.80) outperformed MR (AUC = 0.57) and MP (AUC = 0.76) in predicting EPE on external-data (D2). Conclusions: Results from this preliminary study suggest that a combination of radiomic and pathomic features can better predict post-surgical outcomes (rising PSA and EPE) compared to either of them individually as well as extant prognostic nomogram (CAPRA).

Deep learning reveals lung shape differences on baseline chest CT between mild and severe COVID-19: A multi-site retrospective study.

Severe COVID-19 can lead to extensive lung disease causing lung architectural distortion. In this study we employed machine learning and statistical atlas-based approaches to explore possible changes in lung shape among COVID-19 patients and evaluated whether the extent of these changes was associated with COVID-19 severity. On a large multi-institutional dataset (N = 3443), three different populations were defined; a) healthy (no COVID-19), b) mild COVID-19 (no ventilator required), c) severe COVID-19 (ventilator required), and the presence of lung shape differences between them were explored using baseline chest CT. Significant lung shape differences were observed along mediastinal surfaces of the lungs across all severity of COVID-19 disease. Additionally, differences were seen on basal surfaces of the lung when compared between healthy and severe COVID-19 patients. Finally, an AI model (a 3D residual convolutional network) characterizing these shape differences coupled with lung infiltrates (ground-glass opacities and consolidation regions) was found to be associated with COVID-19 severity.

Multi-scale statistical deformation based co-registration of prostate MRI and post-surgical whole mount histopathology.

BACKGROUND: Accurate delineations of regions of interest (ROIs) on multi-parametric magnetic resonance imaging (mpMRI) are crucial for development of automated, machine learning-based prostate cancer (PCa) detection and segmentation models. However, manual ROI delineations are labor-intensive and susceptible to inter-reader variability. Histopathology images from radical prostatectomy (RP) represent the "gold standard" in terms of the delineation of disease extents, for example, PCa, prostatitis, and benign prostatic hyperplasia (BPH). Co-registering digitized histopathology images onto pre-operative mpMRI enables automated mapping of the ground truth disease extents onto mpMRI, thus enabling the development of machine learning tools for PCa detection and risk stratification. Still, MRI-histopathology co-registration is challenging due to various artifacts and large deformation between in vivo MRI and ex vivo whole-mount histopathology images (WMHs). Furthermore, the artifacts on WMHs, such as tissue loss, may introduce unrealistic deformation during co-registration. PURPOSE: This study presents a new registration pipeline, MSERgSDM, a multi-scale feature-based registration (MSERg) with a statistical deformation (SDM) constraint, which aims to improve accuracy of MRI-histopathology co-registration. METHODS: In this study, we collected 85 pairs of MRI and WMHs from 48 patients across three cohorts. Cohort 1 (D1), comprised of a unique set of 3D printed mold data from six patients, facilitated the generation of ground truth deformations between ex vivo WMHs and in vivo MRI. The other two clinically acquired cohorts (D2 and D3) included 42 patients. Affine and nonrigid registrations were employed to minimize the deformation between ex vivo WMH and ex vivo T2-weighted MRI (T2WI) in D1. Subsequently, ground truth deformation between in vivo T2WI and ex vivo WMH was approximated as the deformation between in vivo T2WI and ex vivo T2WI. In D2 and D3, the prostate anatomical annotations, for example, tumor and urethra, were made by a pathologist and a radiologist in collaboration. These annotations included ROI boundary contours and landmark points. Before applying the registration, manual corrections were made for flipping and rotation of WMHs. MSERgSDM comprises two main components: (1) multi-scale representation construction, and (2) SDM construction. For the SDM construction, we collected N = 200 reasonable deformation fields generated using MSERg, verified through visual inspection. Three additional methods, including intensity-based registration, ProsRegNet, and MSERg, were also employed for comparison against MSERgSDM. RESULTS: Our results suggest that MSERgSDM performed comparably to the ground truth (p > 0.05). Additionally, MSERgSDM (ROI Dice ratio = 0.61, landmark distance = 3.26 mm) exhibited significant improvement over MSERg (ROI Dice ratio = 0.59, landmark distance = 3.69 mm) and ProsRegNet (ROI Dice ratio = 0.56, landmark distance = 4.00 mm) in local alignment. CONCLUSIONS: This study presents a novel registration method, MSERgSDM, for mapping ex vivo WMH onto in vivo prostate MRI. Our preliminary results demonstrate that MSERgSDM can serve as a valuable tool to map ground truth disease annotations from histopathology images onto MRI, thereby assisting in the development of machine learning models for PCa detection on MRI.

Laterality of Radiation Therapy in Breast Cancer is Not Associated With Increased Risk of Coronary Artery Disease in the Contemporary Era.

Purpose: External beam radiation therapy (EBRT) is a critical component of breast cancer (BC) therapy. Given the improvement in technology in the contemporary era, we hypothesized that there is no difference in the development of or worsening of existing coronary artery disease (CAD) in patients with BC receiving left versus right-sided radiation. Methods and Materials: For the meta-analysis portion of our study, we searched PubMed, Web of Science, and Scopus and included studies from January 1999 to September 2022. CAD was identified using a homogenous metric across multiple studies included. We computed the risk ratio (RR) for included studies using a random effects model. For the institutional cohort portion of our study, we selected high cardiovascular-risk patients who received diagnoses of BC between 2010 and 2022 if they met our inclusion criteria. We performed a Cox proportional hazards model with stepwise adjustment. Results: A pooled random effects model with 9 studies showed that patients with left-sided BC receiving EBRT had a 10% increased risk of CAD when compared with patients with right-sided BC receiving EBRT (RR, 1.10; 95% CI, 1.02-1.18; P = .01). However, subgroup analysis of 6 studies that included patients diagnosed after 1980 did not show a significant difference in CAD based on BC laterality (RR, 1.07; 95% CI, 0.95-1.20; P = .27). For the institutional cohort portion of the study, we found that patients with left-sided BC who received EBRT did not have a significantly higher risk of CAD when compared with their right-sided counterparts (hazard ratios [HR], 0.73; 95% CI, 0.34-1.54; P = .402). Conclusions: Our study suggests a historical trend of increased CAD in BC patients receiving left-sided EBRT. Data from patients diagnosed after 2010 in our institutional cohort did not show a significant difference, emphasizing that modern EBRT regimens are safe, and laterality of BC does not affect CAD outcomes in the short term after a BC diagnosis.

Neoadjuvant cabozantinib restores CD8+ T cells in patients with locally advanced non-metastatic clear cell renal cell carcinoma: a phase 2 trial.

Cabozantinib is an oral multikinase inhibitor approved for treatment in metastatic renal cell carcinoma (RCC). We hypothesized that neoadjuvant cabozantinib could downstage localized tumors, facilitating partial nephrectomy, and facilitating surgery in patients with locally advanced tumors that would require significant adjacent organ resection. We, therefore, conducted a phase 2, single-arm trial of cabozantinib treatment for 12 weeks in 17 patients with locally advanced biopsy-proven non-metastatic clear cell RCC before surgical resection. Six patients (35%) experienced a partial response, and 11 patients (65%) had stable disease. We identified that plasma cell-free DNA (cfDNA), VEGF, c-MET, Gas6, and AXL were significantly increased while VEGFR2 decreased during cabozantinib treatments. There was a trend towards CD8+ T cells becoming activated in the blood, expressing the proliferation marker Ki67 and activation markers HLA-DR and CD38. Cabozantinib treatment depleted myeloid populations acutely. Importantly, immune niches made up of the stem-like CD8+ T cells and antigen presenting cells were increased in every patient. These data suggest that cabozantinib treatment was clinically active and safe in the neoadjuvant setting in patients with locally advanced non-metastatic clear cell RCC and activated the anti-tumor CD8+ T cell response. The trial is registered at ClinicalTrials.gov under registration no. NCT04022343.

"Shortcuts" Causing Bias in Radiology Artificial Intelligence: Causes, Evaluation, and Mitigation.

Despite the expert-level performance of artificial intelligence (AI) models for various medical imaging tasks, real-world performance failures with disparate outputs for various subgroups limit the usefulness of AI in improving patients' lives. Many definitions of fairness have been proposed, with discussions of various tensions that arise in the choice of an appropriate metric to use to evaluate bias; for example, should one aim for individual or group fairness? One central observation is that AI models apply "shortcut learning" whereby spurious features (such as chest tubes and portable radiographic markers on intensive care unit chest radiography) on medical images are used for prediction instead of identifying true pathology. Moreover, AI has been shown to have a remarkable ability to detect protected attributes of age, sex, and race, while the same models demonstrate bias against historically underserved subgroups of age, sex, and race in disease diagnosis. Therefore, an AI model may take shortcut predictions from these correlations and subsequently generate an outcome that is biased toward certain subgroups even when protected attributes are not explicitly used as inputs into the model. As a result, these subgroups became nonprivileged subgroups. In this review, the authors discuss the various types of bias from shortcut learning that may occur at different phases of AI model development, including data bias, modeling bias, and inference bias. The authors thereafter summarize various tool kits that can be used to evaluate and mitigate bias and note that these have largely been applied to nonmedical domains and require more evaluation for medical AI. The authors then summarize current techniques for mitigating bias from preprocessing (data-centric solutions) and during model development (computational solutions) and postprocessing (recalibration of learning). Ongoing legal changes where the use of a biased model will be penalized highlight the necessity of understanding, detecting, and mitigating biases from shortcut learning and will require diverse research teams looking at the whole AI pipeline.

Novel radiomic analysis on bi-parametric MRI for characterizing differences between MR non-visible and visible clinically significant prostate cancer.

Background: around one third of clinically significant prostate cancer (CsPCa) foci are reported to be MRI non-visible (MRI─). Objective: To quantify the differences between MR visible (MRI+) and MRI─ CsPCa using intra- and peri-lesional radiomic features on bi-parametric MRI (bpMRI). Methods: This retrospective and multi-institutional study comprised 164 patients with pre-biopsy 3T prostate multi-parametric MRI from 2014 to 2017. The MRI─ CsPCa referred to lesions with PI-RADS v2 score < 3 but ISUP grade group > 1. Three experienced radiologists were involved in annotating lesions and PI-RADS assignment. The validation set (Dv) comprised 52 patients from a single institution, the remaining 112 patients were used for training (Dt). 200 radiomic features were extracted from intra-lesional and peri-lesional regions on bpMRI.Logistic regression with least absolute shrinkage and selection operator (LASSO) and 10-fold cross-validation was applied on Dt to identify radiomic features associated with MRI─ and MRI+ CsPCa to generate corresponding risk scores RMRI─ and RMRI+. RbpMRI was further generated by integrating RMRI─ and RMRI+. Statistical significance was determined using the Wilcoxon signed-rank test. Results: Both intra-lesional and peri-lesional bpMRI Haralick and CoLlAGe radiomic features were significantly associated with MRI─ CsPCa (p < 0.05). Intra-lesional ADC Haralick and CoLlAGe radiomic features were significantly different among MRI─ and MRI+ CsPCa (p < 0.05). RbpMRI yielded the highest AUC of 0.82 (95 % CI 0.72-0.91) compared to AUCs of RMRI+ 0.76 (95 % CI 0.63-0.89), and PI-RADS 0.58 (95 % CI 0.50-0.72) on Dv. RbpMRI correctly reclassified 10 out of 14 MRI─ CsPCa on Dv. Conclusion: Our preliminary results demonstrated that both intra-lesional and peri-lesional bpMRI radiomic features were significantly associated with MRI─ CsPCa. These features could assist in CsPCa identification on bpMRI.

Delta radiomic patterns on serial bi-parametric MRI are associated with pathologic upgrading in prostate cancer patients on active surveillance: preliminary findings.

Objective: The aim of this study was to quantify radiomic changes in prostate cancer (PCa) progression on serial MRI among patients on active surveillance (AS) and evaluate their association with pathologic progression on biopsy. Methods: This retrospective study comprised N = 121 biopsy-proven PCa patients on AS at a single institution, of whom N = 50 at baseline conformed to the inclusion criteria. ISUP Gleason Grade Groups (GGG) were obtained from 12-core TRUS-guided systematic biopsies at baseline and follow-up. A biopsy upgrade (AS+) was defined as an increase in GGG (or in number of positive cores) and no upgrade (AS-) was defined when GGG remained the same during a median period of 18 months. Of N = 50 patients at baseline, N = 30 had MRI scans available at follow-up (median interval = 18 months) and were included for delta radiomic analysis. A total of 252 radiomic features were extracted from the PCa region of interest identified by board-certified radiologists on 3T bi-parametric MRI [T2-weighted (T2W) and apparent diffusion coefficient (ADC)]. Delta radiomic features were computed as the difference of radiomic feature between baseline and follow-up scans. The association of AS+ with age, prostate-specific antigen (PSA), Prostate Imaging Reporting and Data System (PIRADS v2.1) score, and tumor size was evaluated at baseline and follow-up. Various prediction models were built using random forest (RF) classifier within a threefold cross-validation framework leveraging baseline radiomics (Cbr), baseline radiomics + baseline clinical (Cbrbcl), delta radiomics (CΔr), delta radiomics + baseline clinical (CΔrbcl), and delta radiomics + delta clinical (CΔrΔcl). Results: An AUC of 0.64 ± 0.09 was obtained for Cbr, which increased to 0.70 ± 0.18 with the integration of clinical variables (Cbrbcl). CΔr yielded an AUC of 0.74 ± 0.15. Integrating delta radiomics with baseline clinical variables yielded an AUC of 0.77 ± 0.23. CΔrΔclresulted in the best AUC of 0.84 ± 0.20 (p < 0.05) among all combinations. Conclusion: Our preliminary findings suggest that delta radiomics were more strongly associated with upgrade events compared to PIRADS and other clinical variables. Delta radiomics on serial MRI in combination with changes in clinical variables (PSA and tumor volume) between baseline and follow-up showed the strongest association with biopsy upgrade in PCa patients on AS. Further independent multi-site validation of these preliminary findings is warranted.

Prostate Surface Distension and Tumor Texture Descriptors From Pre-Treatment MRI Are Associated With Biochemical Recurrence Following Radical Prostatectomy: Preliminary Findings.

Objective: To derive and evaluate the association of prostate shape distension descriptors from T2-weighted MRI (T2WI) with prostate cancer (PCa) biochemical recurrence (BCR) post-radical prostatectomy (RP) independently and in conjunction with texture radiomics of PCa. Methods: This retrospective study comprised 133 PCa patients from two institutions who underwent 3T-MRI prior to RP and were followed up with PSA measurements for ≥3 years. A 3D shape atlas-based approach was adopted to derive prostate shape distension descriptors from T2WI, and these descriptors were used to train a random forest classifier (CS ) to predict BCR. Texture radiomics was derived within PCa regions of interest from T2WI and ADC maps, and another machine learning classifier (CR ) was trained for BCR. An integrated classifier CS + R was then trained using predictions from CS and CR . These models were trained on D1 (N = 71, 27 BCR+) and evaluated on independent hold-out set D2 (N = 62, 12 BCR+). CS + R was compared against pre-RP, post-RP clinical variables, and extant nomograms for BCR-free survival (bFS) at 3 years. Results: CS + R resulted in a higher AUC (0.75) compared to CR (0.70, p = 0.04) and CS (0.69, p = 0.01) on D2 in predicting BCR. On univariable analysis, CS + R achieved a higher hazard ratio (2.89, 95% CI 0.35-12.81, p < 0.01) compared to other pre-RP clinical variables for bFS. CS + R , pathologic Gleason grade, extraprostatic extension, and positive surgical margins were associated with bFS (p < 0.05). CS + R resulted in a higher C-index (0.76 ± 0.06) compared to CAPRA (0.69 ± 0.09, p < 0.01) and Decipher risk (0.59 ± 0.06, p < 0.01); however, it was comparable to post-RP CAPRA-S (0.75 ± 0.02, p = 0.07). Conclusions: Radiomic shape descriptors quantifying prostate surface distension complement texture radiomics of prostate cancer on MRI and result in an improved association with biochemical recurrence post-radical prostatectomy.

An integrated nomogram combining deep learning, Prostate Imaging-Reporting and Data System (PI-RADS) scoring, and clinical variables for identification of clinically significant prostate cancer on biparametric MRI: a retrospective multicentre study.

BACKGROUND: Biparametric MRI (comprising T2-weighted MRI and apparent diffusion coefficient maps) is increasingly being used to characterise prostate cancer. Although previous studies have combined Prostate Imaging-Reporting & Data System (PI-RADS)-based MRI findings with routinely available clinical variables and with deep learning-based imaging predictors, respectively, for prostate cancer risk stratification, none have combined all three. We aimed to construct an integrated nomogram (referred to as ClaD) combining deep learning-based imaging predictions, PI-RADS scoring, and clinical variables to identify clinically significant prostate cancer on biparametric MRI. METHODS: In this retrospective multicentre study, we included patients with prostate cancer, with histopathology or biopsy reports and a screening or diagnostic MRI scan in the axial view, from four cohorts in the USA (from University Hospitals Cleveland Medical Center, Icahn School of Medicine at Mount Sinai, Cleveland Clinic, and Long Island Jewish Medical Center) and from the PROSTATEx Challenge dataset in the Netherlands. We constructed an integrated nomogram combining deep learning, PI-RADS score, and clinical variables (prostate-specific antigen, prostate volume, and lesion volume) using multivariable logistic regression to identify clinically significant prostate cancer on biparametric MRI. We used data from the first three cohorts to train the nomogram and data from the remaining two cohorts for independent validation. We compared the performance of our ClaD integrated nomogram with that of integrated nomograms combining clinical variables with either the deep learning-based imaging predictor (referred to as DIN) or PI-RADS score (referred to as PIN) using area under the receiver operating characteristic curves (AUCs). We also compared the ability of the nomograms to predict biochemical recurrence on a subset of patients who had undergone radical prostatectomy. We report cross-validation AUCs as means for the training set and used AUCs with 95% CIs to assess the performance on the test set. The difference in AUCs between the models were tested for statistical significance using DeLong's test. We used log-rank tests and Kaplan-Meier curves to analyse survival. FINDINGS: We investigated 592 patients (823 lesions) with prostate cancer who underwent 3T multiparametric MRI at five hospitals in the USA between Jan 8, 2009, and June 3, 2017. The training data set consisted of 368 patients from three sites (the PROSTATEx Challenge cohort [n=204], University Hospitals Cleveland Medical Center [n=126], and Icahn School of Medicine at Mount Sinai [n=38]), and the independent validation data set consisted of 224 patients from two sites (Cleveland Clinic [n=151] and Long Island Jewish Medical Center [n=73]). The ClaD clinical nomogram yielded an AUC of 0·81 (95% CI 0·76-0·85) for identification of clinically significant prostate cancer in the validation data set, significantly improving performance over the DIN (0·74 [95% CI 0·69-0·80], p=0·0005) and PIN (0·76 [0·71-0·81], p<0·0001) nomograms. In the subset of patients who had undergone radical prostatectomy (n=81), the ClaD clinical nomogram resulted in a significant separation in Kaplan-Meier survival curves between patients with and without biochemical recurrence (HR 5·92 [2·34-15·00], p=0·044), whereas the DIN (1·22 [0·54-2·79], p=0·65) and PIN nomograms did not (1·30 [0·62-2·71], p=0·51). INTERPRETATION: Risk stratification of patients with prostate cancer using the integrated ClaD nomogram could help to identify patients with prostate cancer who are at low risk, very low risk, and favourable intermediate risk, who might be candidates for active surveillance, and could also help to identify patients with lethal prostate cancer who might benefit from adjuvant therapy. FUNDING: National Cancer Institute of the US National Institutes of Health, National Institute for Biomedical Imaging and Bioengineering, National Center for Research Resources, US Department of Veterans Affairs Biomedical Laboratory Research and Development Service, US Department of Defense, US National Institute of Diabetes and Digestive and Kidney Diseases, The Ohio Third Frontier Technology Validation Fund, Case Western Reserve University, Dana Foundation, and Clinical and Translational Science Collaborative.