Characterization of renal masses with MRI-based radiomics: assessment of inter-package and inter-observer reproducibility in a prospective pilot study.

OBJECTIVES: To evaluate radiomics features' reproducibility using inter-package/inter-observer measurement analysis in renal masses (RMs) based on MRI and to employ machine learning (ML) models for RM characterization. METHODS: 32 Patients (23M/9F; age 61.8 ± 10.6 years) with RMs (25 renal cell carcinomas (RCC)/7 benign masses; mean size, 3.43 ± 1.73 cm) undergoing resection were prospectively recruited. All patients underwent 1.5 T MRI with T2-weighted (T2-WI), diffusion-weighted (DWI)/apparent diffusion coefficient (ADC), and pre-/post-contrast-enhanced T1-weighted imaging (T1-WI). RMs were manually segmented using volume of interest (VOI) on T2-WI, DWI/ADC, and T1-WI pre-/post-contrast imaging (1-min, 3-min post-injection) by two independent observers using two radiomics software packages for inter-package and inter-observer assessments of shape/histogram/texture features common to both packages (104 features; n = 26 patients). Intra-class correlation coefficients (ICCs) were calculated to assess inter-observer and inter-package reproducibility of radiomics measurements [good (ICC ≥ 0.8)/moderate (ICC = 0.5-0.8)/poor (ICC < 0.5)]. ML models were employed using reproducible features (between observers and packages, ICC > 0.8) to distinguish RCC from benign RM. RESULTS: Inter-package comparisons demonstrated that radiomics features from T1-WI-post-contrast had the highest proportion of good/moderate ICCs (54.8-58.6% for T1-WI-1 min), while most features extracted from T2-WI, T1-WI-pre-contrast, and ADC exhibited poor ICCs. Inter-observer comparisons found that radiomics measurements from T1-WI pre/post-contrast and T2-WI had the greatest proportion of features with good/moderate ICCs (95.3-99.1% T1-WI-post-contrast 1-min), while ADC measurements yielded mostly poor ICCs. ML models generated an AUC of 0.71 [95% confidence interval = 0.67-0.75] for diagnosis of RCC vs. benign RM. CONCLUSION: Radiomics features extracted from T1-WI-post-contrast demonstrated greater inter-package and inter-observer reproducibility compared to ADC, with fair accuracy for distinguishing RCC from benign RM. CLINICAL RELEVANCE: Knowledge of reproducibility of MRI radiomics features obtained on renal masses will aid in future study design and may enhance the diagnostic utility of radiomics models for renal mass characterization.

Prediction of locally advanced rectal cancer response to neoadjuvant chemoradiation therapy using volumetric multiparametric MRI-based radiomics.

PURPOSE: To assess the role of pretreatment multiparametric (mp)MRI-based radiomic features in predicting pathologic complete response (pCR) of locally advanced rectal cancer (LARC) to neoadjuvant chemoradiation therapy (nCRT). METHODS: This was a retrospective dual-center study including 98 patients (M/F 77/21, mean age 60 years) with LARC who underwent pretreatment mpMRI followed by nCRT and total mesorectal excision or watch and wait. Fifty-eight patients from institution 1 constituted the training set and 40 from institution 2 the validation set. Manual segmentation using volumes of interest was performed on T1WI pre-/post-contrast, T2WI and diffusion-weighted imaging (DWI) sequences. Demographic information and serum carcinoembryonic antigen (CEA) levels were collected. Shape, 1st and 2nd order radiomic features were extracted and entered in models based on principal component analysis used to predict pCR. The best model was obtained using a k-fold cross-validation method on the training set, and AUC, sensitivity and specificity for prediction of pCR were calculated on the validation set. RESULTS: Stage distribution was T3 (n = 79) or T4 (n = 19). Overall, 16 (16.3%) patients achieved pCR. Demographics, MRI TNM stage, and CEA were not predictive of pCR (p range 0.59-0.96), while several radiomic models achieved high diagnostic performance for prediction of pCR (in the validation set), with AUCs ranging from 0.7 to 0.9, with the best model based on high b-value DWI demonstrating AUC of 0.9 [95% confidence intervals: 0.67, 1], sensitivity of 100% [100%, 100%], and specificity of 81% [66%, 96%]. CONCLUSION: Radiomic models obtained from pre-treatment MRI show good to excellent performance for the prediction of pCR in patients with LARC, superior to clinical parameters and CEA. A larger study is needed for confirmation of these results.

Discovery Viewer (DV): Web-Based Medical AI Model Development Platform and Deployment Hub.

The rapid rise of artificial intelligence (AI) in medicine in the last few years highlights the importance of developing bigger and better systems for data and model sharing. However, the presence of Protected Health Information (PHI) in medical data poses a challenge when it comes to sharing. One potential solution to mitigate the risk of PHI breaches is to exclusively share pre-trained models developed using private datasets. Despite the availability of these pre-trained networks, there remains a need for an adaptable environment to test and fine-tune specific models tailored for clinical tasks. This environment should be open for peer testing, feedback, and continuous model refinement, allowing dynamic model updates that are especially important in the medical field, where diseases and scanning techniques evolve rapidly. In this context, the Discovery Viewer (DV) platform was developed in-house at the Biomedical Engineering and Imaging Institute at Mount Sinai (BMEII) to facilitate the creation and distribution of cutting-edge medical AI models that remain accessible after their development. The all-in-one platform offers a unique environment for non-AI experts to learn, develop, and share their own deep learning (DL) concepts. This paper presents various use cases of the platform, with its primary goal being to demonstrate how DV holds the potential to empower individuals without expertise in AI to create high-performing DL models. We tasked three non-AI experts to develop different musculoskeletal AI projects that encompassed segmentation, regression, and classification tasks. In each project, 80% of the samples were provided with a subset of these samples annotated to aid the volunteers in understanding the expected annotation task. Subsequently, they were responsible for annotating the remaining samples and training their models through the platform's "Training Module". The resulting models were then tested on the separate 20% hold-off dataset to assess their performance. The classification model achieved an accuracy of 0.94, a sensitivity of 0.92, and a specificity of 1. The regression model yielded a mean absolute error of 14.27 pixels. And the segmentation model attained a Dice Score of 0.93, with a sensitivity of 0.9 and a specificity of 0.99. This initiative seeks to broaden the community of medical AI model developers and democratize the access of this technology to all stakeholders. The ultimate goal is to facilitate the transition of medical AI models from research to clinical settings.