A Multichannel CT and Radiomics-Guided CNN-ViT (RadCT-CNNViT) Ensemble Network for Diagnosis of Pulmonary Sarcoidosis.

Pulmonary sarcoidosis is a multisystem granulomatous interstitial lung disease (ILD) with a variable presentation and prognosis. The early accurate detection of pulmonary sarcoidosis may prevent progression to pulmonary fibrosis, a serious and potentially life-threatening form of the disease. However, the lack of a gold-standard diagnostic test and specific radiographic findings poses challenges in diagnosing pulmonary sarcoidosis. Chest computed tomography (CT) imaging is commonly used but requires expert, chest-trained radiologists to differentiate pulmonary sarcoidosis from lung malignancies, infections, and other ILDs. In this work, we develop a multichannel, CT and radiomics-guided ensemble network (RadCT-CNNViT) with visual explainability for pulmonary sarcoidosis vs. lung cancer (LCa) classification using chest CT images. We leverage CT and hand-crafted radiomics features as input channels, and a 3D convolutional neural network (CNN) and vision transformer (ViT) ensemble network for feature extraction and fusion before a classification head. The 3D CNN sub-network captures the localized spatial information of lesions, while the ViT sub-network captures long-range, global dependencies between features. Through multichannel input and feature fusion, our model achieves the highest performance with accuracy, sensitivity, specificity, precision, F1-score, and combined AUC of 0.93 ± 0.04, 0.94 ± 0.04, 0.93 ± 0.08, 0.95 ± 0.05, 0.94 ± 0.04, and 0.97, respectively, in a five-fold cross-validation study with pulmonary sarcoidosis (n = 126) and LCa (n = 93) cases. A detailed ablation study showing the impact of CNN + ViT compared to CNN or ViT alone, and CT + radiomics input, compared to CT or radiomics alone, is also presented in this work. Overall, the AI model developed in this work offers promising potential for triaging the pulmonary sarcoidosis patients for timely diagnosis and treatment from chest CT.

3D reconstruction of skin and spatial mapping of immune cell density, vascular distance and effects of sun exposure and aging.

Mapping the human body at single cell resolution in three dimensions (3D) is important for understanding cellular interactions in context of tissue and organ organization. 2D spatial cell analysis in a single tissue section may be limited by cell numbers and histology. Here we show a workflow for 3D reconstruction of multiplexed sequential tissue sections: MATRICS-A (Multiplexed Image Three-D Reconstruction and Integrated Cell Spatial - Analysis). We demonstrate MATRICS-A in 26 serial sections of fixed skin (stained with 18 biomarkers) from 12 donors aged between 32-72 years. Comparing the 3D reconstructed cellular data with the 2D data, we show significantly shorter distances between immune cells and vascular endothelial cells (56 µm in 3D vs 108 µm in 2D). We also show 10-70% more T cells (total) within 30 µm of a neighboring T helper cell in 3D vs 2D. Distances of p53, DDB2 and Ki67 positive cells to the skin surface were consistent across all ages/sun exposure and largely localized to the lower stratum basale layer of the epidermis. MATRICS-A provides a framework for analysis of 3D spatial cell relationships in healthy and aging organs and could be further extended to diseased organs.

An Automatic 3-D Ultrasound and Photoacoustic Combined Imaging System for Human Inflammatory Arthritis.

Aiming at a point-of-care device for rheumatology clinics, we developed an automatic 3-D imaging system combining the emerging photoacoustic (PA) imaging with conventional Doppler ultrasound (US) for detecting human inflammatory arthritis. This system is based on a commercial-grade GE HealthCare (GEHC, Chicago, IL, USA) Vivid E95 US machine and a Universal Robot UR3 robotic arm. This system automatically locates the patient's finger joints from a photograph taken by an overhead camera powered by an automatic hand joint identification method, followed by the robotic arm moving the imaging probe to the targeted joint to scan and obtain 3-D PA and Doppler US images. The GEHC US machine was modified to enable high-speed, high-resolution PA imaging while maintaining the features available on the system. The commercial-grade image quality and the high sensitivity in detecting inflammation in peripheral joints via PA technology hold great potential to significantly benefit clinical care of inflammatory arthritis in a novel way.

High-Speed On-Site Deep Learning-Based FFR-CT Algorithm: Evaluation Using Invasive Angiography as the Reference Standard.

BACKGROUND. Estimation of fractional flow reserve from coronary CTA (FFR-CT) is an established method of assessing the hemodynamic significance of coronary lesions. However, clinical implementation has progressed slowly, partly because of off-site data transfer with long turnaround times for results. OBJECTIVE. The purpose of this study was to evaluate the diagnostic performance of FFR-CT computed on-site with a high-speed deep learning-based algorithm with invasive hemodynamic indexes as the reference standard. METHODS. This retrospective study included 59 patients (46 men, 13 women; mean age, 66.5 ± 10.2 years) who underwent coronary CTA (including calcium scoring) followed within 90 days by invasive angiography with invasive fractional flow reserve (FFR) and/or instantaneous wave-free ratio measurements from December 2014 to October 2021. Coronary artery lesions were considered to have hemodynamically significant stenosis in the presence of invasive FFR of 0.80 or less and/or instantaneous wave-free ratio of 0.89 or less. A single cardiologist evaluated the CTA images using an on-site deep learning-based semiautomated algorithm entailing a 3D computational flow dynamics model to determine FFR-CT for coronary artery lesions detected with invasive angiography. Time for FFR-CT analysis was recorded. FFR-CT analysis was repeated by the same cardiologist in 26 randomly selected examinations and by a different cardiologist in 45 randomly selected examinations. Diagnostic performance and agreement were assessed. RESULTS. A total of 74 lesions were identified with invasive angiography. FFR-CT and invasive FFR had strong correlation (r = 0.81) and, in Bland-Altman analysis, bias of 0.01 and 95% limits of agreement of -0.13 to 0.15. FFR-CT had AUC for hemodynamically significant stenosis of 0.975. At a cutoff of 0.80 or less, FFR-CT had 95.9% accuracy, 93.5% sensitivity, and 97.7% specificity. In 39 lesions with severe calcifications (≥ 400 Agatston units), FFR-CT had AUC of 0.991 and at a cutoff of 0.80, 94.7% sensitivity, 95.0% specificity, and 94.9% accuracy. Mean analysis time per patient was 7 minutes 54 seconds. Intraobserver agreement (intraclass correlation coefficient, 0.85; bias, -0.01; 95% limits of agreement, -0.12 and 0.10) and interobserver agreement (intraclass correlation coefficient, 0.94; bias, -0.01; 95% limits of agreement, -0.08 and 0.07) were good to excellent. CONCLUSION. A high-speed on-site deep learning-based FFR-CT algorithm had excellent diagnostic performance for hemodynamically significant stenosis with high reproducibility. CLINICAL IMPACT. The algorithm should facilitate implementation of FFR-CT technology into routine clinical practice.

Predicting Breast Cancer Events in Ductal Carcinoma In Situ (DCIS) Using Generative Adversarial Network Augmented Deep Learning Model.

Standard clinicopathological parameters (age, growth pattern, tumor size, margin status, and grade) have been shown to have limited value in predicting recurrence in ductal carcinoma in situ (DCIS) patients. Early and accurate recurrence prediction would facilitate a more aggressive treatment policy for high-risk patients (mastectomy or adjuvant radiation therapy), and simultaneously reduce over-treatment of low-risk patients. Generative adversarial networks (GAN) are a class of DL models in which two adversarial neural networks, generator and discriminator, compete with each other to generate high quality images. In this work, we have developed a deep learning (DL) classification network that predicts breast cancer events (BCEs) in DCIS patients using hematoxylin and eosin (H & E) images. The DL classification model was trained on 67 patients using image patches from the actual DCIS cores and GAN generated image patches to predict breast cancer events (BCEs). The hold-out validation dataset (n = 66) had an AUC of 0.82. Bayesian analysis further confirmed the independence of the model from classical clinicopathological parameters. DL models of H & E images may be used as a risk stratification strategy for DCIS patients to personalize therapy.

A hybrid deformable registration method to generate motion-compensated 3D virtual MRI for fusion with interventional real-time 3D ultrasound.

PURPOSE: Ultrasound is often the preferred modality for image-guided therapy or treatment in organs such as liver due to real-time imaging capabilities. However, the reduced conspicuity of tumors in ultrasound images adversely impacts the precision and accuracy of treatment delivery. This problem is compounded by deformable motion due to breathing and other physiological activity. This creates the need for a fusion method to align interventional US with pre-interventional modalities that provide superior soft-tissue contrast (e.g., MRI) to accurately target a structure-of-interest and compensate for liver motion. METHOD: In this work, we developed a hybrid deformable fusion method to align 3D pre-interventional MRI and 3D interventional US volumes to target the structures-of-interest in liver accurately in real-time. The deformable multimodal fusion method involved an offline alignment of a pre-intervention MRI with a pre-intervention US volume using a traditional registration method, followed by real-time prediction of deformation using a trained deep-learning model between interventional US volumes across different respiratory states. This framework enables motion-compensated MRI-US image fusion in real-time for image-guided treatment. RESULTS: The proposed hybrid deformable registration method was evaluated on three healthy volunteers across the pre-intervention MRI and 20 US volume pairs in the free-breathing respiratory cycle. The mean Euclidean landmark distance of three homologous targets in all three volunteers was less than 3 mm for percutaneous liver procedures. CONCLUSIONS: Preliminary results show that clinically acceptable registration accuracies for near real-time, deformable MRI-US fusion can be achieved by our proposed hybrid approach. The proposed combination of traditional and deep-learning deformable registration techniques is thus a promising approach for motion-compensated MRI-US fusion to improve targeting in image-guided liver interventions.

Deep learning-based automated pipeline for blood vessel detection and distribution analysis in multiplexed prostate cancer images.

Introduction: Prostate cancer is a highly heterogeneous disease, presenting varying levels of aggressiveness and response to treatment. Angiogenesis is one of the hallmarks of cancer, providing oxygen and nutrient supply to tumors. Micro vessel density has previously been correlated with higher Gleason score and poor prognosis. Manual segmentation of blood vessels (BVs) In microscopy images is challenging, time consuming and may be prone to inter-rater variabilities. In this study, an automated pipeline is presented for BV detection and distribution analysis in multiplexed prostate cancer images. Methods: A deep learning model was trained to segment BVs by combining CD31, CD34 and collagen IV images. In addition, the trained model was used to analyze the size and distribution patterns of BVs in relation to disease progression in a cohort of prostate cancer patients (N = 215). Results: The model was capable of accurately detecting and segmenting BVs, as compared to ground truth annotations provided by two reviewers. The precision (P), recall (R) and dice similarity coefficient (DSC) were equal to 0.93 (SD 0.04), 0.97 (SD 0.02) and 0.71 (SD 0.07) with respect to reviewer 1, and 0.95 (SD 0.05), 0.94 (SD 0.07) and 0.70 (SD 0.08) with respect to reviewer 2, respectively. BV count was significantly associated with 5-year recurrence (adjusted p = 0.0042), while both count and area of blood vessel were significantly associated with Gleason grade (adjusted p = 0.032 and 0.003 respectively). Discussion: The proposed methodology is anticipated to streamline and standardize BV analysis, offering additional insights into the biology of prostate cancer, with broad applicability to other cancers.

Tumor Infiltrating Lymphocytes in Multi-National Cohorts of Ductal Carcinoma In Situ (DCIS) of Breast.

Tumor-infiltrating lymphocytes (TILs) are prognostic in invasive breast cancer. However, their prognostic significance in ductal carcinoma in situ (DCIS) has been controversial. To investigate the prognostic role of TILs in DCIS outcome, we used different scoring methods for TILs in multi-national cohorts from Asian and European women. Self-described race was genetically confirmed using QC Infinium array combined with radmixture software. Stromal TILs, touching TILs, circumferential TILs, and hotspots were quantified on H&E-stained slides and correlated with the development of second breast cancer events (BCE) and other clinico-pathological variables. In univariate survival analysis, age older than 50 years, hormone receptor positivity and the presence of circumferential TILs were weakly associated with the absence of BCE at the 5-year follow-up in all cohorts (p < 0.03; p < 0.02; and p < 0.02, respectively, adjusted p = 0.11). In the multivariable analysis, circumferential TILs were an independent predictor of a better outcome (Wald test p = 0.01), whereas younger age was associated with BCE. Asian patients were younger with larger, higher grade, HR negative DCIS lesions, and higher TIL variables. The spatial arrangement of TILs may serve as a better prognostic indicator in DCIS cases than stromal TILs alone and may be added in guidelines for TILs evaluation in DCIS.

Prostate Surface Distension and Tumor Texture Descriptors From Pre-Treatment MRI Are Associated With Biochemical Recurrence Following Radical Prostatectomy: Preliminary Findings.

Objective: To derive and evaluate the association of prostate shape distension descriptors from T2-weighted MRI (T2WI) with prostate cancer (PCa) biochemical recurrence (BCR) post-radical prostatectomy (RP) independently and in conjunction with texture radiomics of PCa. Methods: This retrospective study comprised 133 PCa patients from two institutions who underwent 3T-MRI prior to RP and were followed up with PSA measurements for ≥3 years. A 3D shape atlas-based approach was adopted to derive prostate shape distension descriptors from T2WI, and these descriptors were used to train a random forest classifier (CS ) to predict BCR. Texture radiomics was derived within PCa regions of interest from T2WI and ADC maps, and another machine learning classifier (CR ) was trained for BCR. An integrated classifier CS + R was then trained using predictions from CS and CR . These models were trained on D1 (N = 71, 27 BCR+) and evaluated on independent hold-out set D2 (N = 62, 12 BCR+). CS + R was compared against pre-RP, post-RP clinical variables, and extant nomograms for BCR-free survival (bFS) at 3 years. Results: CS + R resulted in a higher AUC (0.75) compared to CR (0.70, p = 0.04) and CS (0.69, p = 0.01) on D2 in predicting BCR. On univariable analysis, CS + R achieved a higher hazard ratio (2.89, 95% CI 0.35-12.81, p < 0.01) compared to other pre-RP clinical variables for bFS. CS + R , pathologic Gleason grade, extraprostatic extension, and positive surgical margins were associated with bFS (p < 0.05). CS + R resulted in a higher C-index (0.76 ± 0.06) compared to CAPRA (0.69 ± 0.09, p < 0.01) and Decipher risk (0.59 ± 0.06, p < 0.01); however, it was comparable to post-RP CAPRA-S (0.75 ± 0.02, p = 0.07). Conclusions: Radiomic shape descriptors quantifying prostate surface distension complement texture radiomics of prostate cancer on MRI and result in an improved association with biochemical recurrence post-radical prostatectomy.

A new machine learning approach for predicting likelihood of recurrence following ablation for atrial fibrillation from CT.

OBJECTIVE: To investigate left atrial shape differences on CT scans of atrial fibrillation (AF) patients with (AF+) versus without (AF-) post-ablation recurrence and whether these shape differences predict AF recurrence. METHODS: This retrospective study included 68 AF patients who had pre-catheter ablation cardiac CT scans with contrast. AF recurrence was defined at 1 year, excluding a 3-month post-ablation blanking period. After creating atlases of atrial models from segmented AF+ and AF- CT images, an atlas-based implicit shape differentiation method was used to identify surface of interest (SOI). After registering the SOI to each patient model, statistics of the deformation on the SOI were used to create shape descriptors. The performance in predicting AF recurrence using shape features at and outside the SOI and eight clinical factors (age, sex, left atrial volume, left ventricular ejection fraction, body mass index, sinus rhythm, and AF type [persistent vs paroxysmal], catheter-ablation type [Cryoablation vs Irrigated RF]) were compared using 100 runs of fivefold cross validation. RESULTS: Differences in atrial shape were found surrounding the pulmonary vein ostia and the base of the left atrial appendage. In the prediction of AF recurrence, the area under the receiver-operating characteristics curve (AUC) was 0.67 for shape features from the SOI, 0.58 for shape features outside the SOI, 0.71 for the clinical parameters, and 0.78 combining shape and clinical features. CONCLUSION: Differences in left atrial shape were identified between AF recurrent and non-recurrent patients using pre-procedure CT scans. New radiomic features corresponding to the differences in shape were found to predict post-ablation AF recurrence.

Similarity clustering-based atlas selection for pelvic CT image segmentation.

PURPOSE: To demonstrate selection of a small representative subset of images from a pool of images comprising a potential atlas (PA) pelvic CT set to be used for autosegmentation of a separate target image set. The aim is to balance the need for the atlas set to represent anatomical diversity with the need to minimize resources required to create a high quality atlas set (such as multiobserver delineation), while retaining access to additional information available for the PA image set. METHODS: Preprocessing was performed for image standardization, followed by image registration. Clustering was used to select the subset that provided the best coverage of a target dataset as measured by postregistration image intensity similarities. Tests for clustering robustness were performed including repeated clustering runs using different starting seeds and clustering repeatedly using 90% of the target dataset chosen randomly. Comparisons of coverage of a target set (comprising 711 pelvic CT images) were made for atlas sets of five images (chosen from a PA set of 39 pelvic CT and MR images) (a) at random (averaged over 50 random atlas selections), (b) based solely on image similarities within the PA set (representing prospective atlas development), (c) based on similarities within the PA set and between the PA and target dataset (representing retrospective atlas development). Comparisons were also made to coverage provided by the entire PA set of 39 images. RESULTS: Exemplar selection was highly robust with exemplar selection results being unaffected by choice of starting seed with very occasional change to one of the exemplar choices when the target set was reduced. Coverage of the target set, as measured by best normalized cross-correlation similarity of target images to any exemplar image, provided by five well-selected atlas images (mean = 0.6497) was more similar to coverage provided by the entire PA set (mean = 0.6658) than randomly chosen atlas subsets (mean = 0.5977). This was true both of the mean values and the shape of the distributions. Retrospective selection of atlases (mean = 0.6497) provided a very small improvement over prospective atlas selection (mean = 0.6431). All differences were significant (P < 1.0E-10). CONCLUSIONS: Selection of a small representative image set from one dataset can be utilized to develop an atlas set for either retrospective or prospective autosegmentation of a different target dataset. The coverage provided by such a judiciously selected subset has the potential to facilitate propagation of numerous retrospectively defined structures, utilizing additional information available with multimodal imaging in the atlas set, without the need to create large atlas image sets.

Mass Effect Deformation Heterogeneity (MEDH) on Gadolinium-contrast T1-weighted MRI is associated with decreased survival in patients with right cerebral hemisphere Glioblastoma: A feasibility study.

Subtle tissue deformations caused by mass-effect in Glioblastoma (GBM) are often not visually evident, and may cause neurological deficits, impacting survival. Radiomic features provide sub-visual quantitative measures to uncover disease characteristics. We present a new radiomic feature to capture mass effect-induced deformations in the brain on Gadolinium-contrast (Gd-C) T1w-MRI, and their impact on survival. Our rationale is that larger variations in deformation within functionally eloquent areas of the contralateral hemisphere are likely related to decreased survival. Displacements in the cortical and subcortical structures were measured by aligning the Gd-C T1w-MRI to a healthy atlas. The variance of deformation magnitudes was measured and defined as Mass Effect Deformation Heterogeneity (MEDH) within the brain structures. MEDH values were then correlated with overall-survival of 89 subjects on the discovery cohort, with tumors on the right (n = 41) and left (n = 48) cerebral hemispheres, and evaluated on a hold-out cohort (n = 49 subjects). On both cohorts, decreased survival time was found to be associated with increased MEDH in areas of language comprehension, social cognition, visual perception, emotion, somato-sensory, cognitive and motor-control functions, particularly in the memory areas in the left-hemisphere. Our results suggest that higher MEDH in functionally eloquent areas of the left-hemisphere due to GBM in the right-hemisphere may be associated with poor-survival.

Radiomic features from pretreatment biparametric MRI predict prostate cancer biochemical recurrence: Preliminary findings.

BACKGROUND: Radiomics or computer-extracted texture features derived from MRI have been shown to help quantitatively characterize prostate cancer (PCa). Radiomics have not been explored depth in the context of predicting biochemical recurrence (BCR) of PCa. PURPOSE: To identify a set of radiomic features derived from pretreatment biparametric MRI (bpMRI) that may be predictive of PCa BCR. STUDY TYPE: Retrospective. SUBJECTS: In all, 120 PCa patients from two institutions, I1 and I2 , partitioned into training set D1 (N = 70) from I1 and independent validation set D2 (N = 50) from I2 . All patients were followed for ≥3 years. SEQUENCE: 3T, T2 -weighted (T2 WI) and apparent diffusion coefficient (ADC) maps derived from diffusion-weighted sequences. ASSESSMENT: PCa regions of interest (ROIs) on T2 WI were annotated by two experienced radiologists. Radiomic features from bpMRI (T2 WI and ADC maps) were extracted from the ROIs. A machine-learning classifier (CBCR ) was trained with the best discriminating set of radiomic features to predict BCR (pBCR ). STATISTICAL TESTS: Wilcoxon rank-sum tests with P < 0.05 were considered statistically significant. Differences in BCR-free survival at 3 years using pBCR was assessed using the Kaplan-Meier method and compared with Gleason Score (GS), PSA, and PIRADS-v2. RESULTS: Distribution statistics of co-occurrence of local anisotropic gradient orientation (CoLlAGe) and Haralick features from T2 WI and ADC were associated with BCR (P < 0.05) on D1 . CBCR predictions resulted in a mean AUC = 0.84 on D1 and AUC = 0.73 on D2 . A significant difference in BCR-free survival between the predicted classes (BCR + and BCR-) was observed (P = 0.02) on D2 compared to those obtained from GS (P = 0.8), PSA (P = 0.93) and PIRADS-v2 (P = 0.23). DATA CONCLUSION: Radiomic features from pretreatment bpMRI can be predictive of PCa BCR after therapy and may help identify men who would benefit from adjuvant therapy. LEVEL OF EVIDENCE: 4 Technical Efficacy: Stage 5 J. Magn. Reson. Imaging 2018;48:1626-1636.

Radiomic features on MRI enable risk categorization of prostate cancer patients on active surveillance: Preliminary findings.

BACKGROUND: Radiomic analysis is defined as computationally extracting features from radiographic images for quantitatively characterizing disease patterns. There has been recent interest in examining the use of MRI for identifying prostate cancer (PCa) aggressiveness in patients on active surveillance (AS). PURPOSE: To evaluate the performance of MRI-based radiomic features in identifying the presence or absence of clinically significant PCa in AS patients. STUDY TYPE: Retrospective. SUBJECTS MODEL: MRI/TRUS (transperineal grid ultrasound) fusion-guided biopsy was performed for 56 PCa patients on AS who had undergone prebiopsy. FIELD STRENGTH/SEQUENCE: 3T, T2 -weighted (T2 w) and diffusion-weighted (DW) MRI. ASSESSMENT: A pathologist histopathologically defined the presence of clinically significant disease. A radiologist manually delineated lesions on T2 w-MRs. Then three radiologists assessed MRIs using PIRADS v2.0 guidelines. Tumors were categorized into four groups: MRI-negative-biopsy-negative (Group 1, N = 15), MRI-positive-biopsy-positive (Group 2, N = 16), MRI-negative-biopsy-positive (Group 3, N = 10), and MRI-positive-biopsy-negative (Group 4, N = 15). In all, 308 radiomic features (First-order statistics, Gabor, Laws Energy, and Haralick) were extracted from within the annotated lesions on T2 w images and apparent diffusion coefficient (ADC) maps. The top 10 features associated with clinically significant tumors were identified using minimum-redundancy-maximum-relevance and used to construct three machine-learning models that were independently evaluated for their ability to identify the presence and absence of clinically significant disease. STATISTICAL TESTS: Wilcoxon rank-sum tests with P < 0.05 considered statistically significant. RESULTS: Seven T2 w-based (First-order Statistics, Haralick, Laws, and Gabor) and three ADC-based radiomic features (Laws, Gradient and Sobel) exhibited statistically significant differences (P < 0.001) between malignant and normal regions in the training groups. The three constructed models yielded overall accuracy improvement of 33, 60, 80% and 30, 40, 60% for patients in testing groups, when compared to PIRADS v2.0 alone. DATA CONCLUSION: Radiomic features could help in identifying the presence and absence of clinically significant disease in AS patients when PIRADS v2.0 assessment on MRI contradicted pathology findings of MRI-TRUS prostate biopsies. LEVEL OF EVIDENCE: 3 Technical Efficacy: Stage 2 J. Magn. Reson. Imaging 2018.

Radiomics and radiogenomics in lung cancer: A review for the clinician.

Lung cancer is responsible for a large proportion of cancer-related deaths across the globe, with delayed detection being perhaps the most significant factor for its high mortality rate. Though the National Lung Screening Trial argues for screening of certain at-risk populations, the practical implementation of these screening efforts has not yet been successful and remains in high demand. Radiomics refers to the computerized extraction of data from radiologic images, and provides unique potential for making lung cancer screening more rapid and accurate using machine learning algorithms. The quantitative features analyzed express subvisual characteristics of images which correlate with pathogenesis of diseases. These features are broadly classified into four categories: intensity, structure, texture/gradient, and wavelet, based on the types of image attributes they capture. Many studies have been done to show correlation between these features and the malignant potential of a nodule on a chest CT. In cancer patients, these nodules also have features that can be correlated with prognosis and mutation status. The major limitations of radiomics are the lack of standardization of acquisition parameters, inconsistent radiomic methods, and lack of reproducibility. Researchers are working on overcoming these limitations, which would make radiomics more acceptable in the medical community.

Prostate shapes on pre-treatment MRI between prostate cancer patients who do and do not undergo biochemical recurrence are different: Preliminary Findings.

Early identification of PCa patients at risk for biochemical recurrence (BCR) post-therapy will potentially complement definitive therapy with either neo- or adjuvant therapy to improve prognosis. BCR post definitive therapy is often associated with disease progression that might cause a bulge in the prostate gland. In this work we explored if an atlas-based comparison approach reveals shape differences in the prostate capsule as observed on pre-treatment T2-weighted MRI between prostate cancer patients who do (BCR +) and do not (BCR -) have BCR following definitive therapy. A single center IRB approved study included 874 patients. Complete image datasets, clinically localized PCa, availability of Gleason score, data available for post-treatment PSA and follow-up for at least 3 years in patients without BCR were the inclusion criteria to select 77 patients out of the 874 patients. Further controlling for Gleason score, stage, age and to maintain equal number of cases for the BCR + and BCR - categories, the total number of cases was reduced to 50. Manually segmented prostate capsules were aligned to a BCR - template for statistical comparison between the BCR + and BCR - groups. Statistically significant shape difference between the two groups was observed towards the lateral and the posterior sides of prostate.

Regression and statistical shape model based substitute CT generation for MRI alone external beam radiation therapy from standard clinical MRI sequences.

In MR only radiation therapy planning, generation of the tissue specific HU map directly from the MRI would eliminate the need of CT image acquisition and may improve radiation therapy planning. The aim of this work is to generate and validate substitute CT (sCT) scans generated from standard T2 weighted MR pelvic scans in prostate radiation therapy dose planning. A Siemens Skyra 3T MRI scanner with laser bridge, flat couch and pelvic coil mounts was used to scan 39 patients scheduled for external beam radiation therapy for localized prostate cancer. For sCT generation a whole pelvis MRI (1.6 mm 3D isotropic T2w SPACE sequence) was acquired. Patients received a routine planning CT scan. Co-registered whole pelvis CT and T2w MRI pairs were used as training images. Advanced tissue specific non-linear regression models to predict HU for the fat, muscle, bladder and air were created from co-registered CT-MRI image pairs. On a test case T2w MRI, the bones and bladder were automatically segmented using a novel statistical shape and appearance model, while other soft tissues were separated using an Expectation-Maximization based clustering model. The CT bone in the training database that was most 'similar' to the segmented bone was then transformed with deformable registration to create the sCT component of the test case T2w MRI bone tissue. Predictions for the bone, air and soft tissue from the separate regression models were successively combined to generate a whole pelvis sCT. The change in monitor units between the sCT-based plans relative to the gold standard CT plan for the same IMRT dose plan was found to be [Formula: see text] (mean ± standard deviation) for 39 patients. The 3D Gamma pass rate was [Formula: see text] (2 mm/2%). The novel hybrid model is computationally efficient, generating an sCT in 20 min from standard T2w images for prostate cancer radiation therapy dose planning and DRR generation.

Substitute CT generation from a single ultra short time echo MRI sequence: preliminary study.

In MR guided radiation therapy planning both MR and CT images for a patient are acquired and co-registered to obtain a tissue specific HU map. Generation of the HU map directly from the MRI would eliminate the CT acquisition and may improve radiation therapy planning. In this preliminary study of substitute CT (sCT) generation, two porcine leg phantoms were scanned using a 3D ultrashort echo time (PETRA) sequence and co-registered to corresponding CT images to build tissue specific regression models. The model was created from one co-registered CT-PETRA pair to generate the sCT for the other PETRA image. An expectation maximization based clustering was performed on the co-registered PETRA image to identify the soft tissues, dense bone and air class membership probabilities. A tissue specific non linear regression model was built from one registered CT-PETRA pair dataset to predict the sCT of the second PETRA image in a two-fold cross validation schema. A complete substitute CT is generated in 3 min. The mean absolute HU error for air was 0.3 HU, bone was 95 HU, fat was 30 HU and for muscle it was 10 HU. The mean surface reconstruction error for the bone was 1.3 mm. The PETRA sequence enabled a low mean absolute surface distance for the bone and a low HU error for other classes. The sCT generated from a single PETRA sequence shows promise for the generation of fast sCT for MRI based radiation therapy planning.

Computational imaging reveals shape differences between normal and malignant prostates on MRI.

We seek to characterize differences in the shape of the prostate and the central gland (combined central and transitional zones) between men with biopsy confirmed prostate cancer and men who were identified as not having prostate cancer either on account of a negative biopsy or had pelvic imaging done for a non-prostate malignancy. T2w MRI from 70 men were acquired at three institutions. The cancer positive group (PCa+) comprised 35 biopsy positive (Bx+) subjects from three institutions (Gleason scores: 6-9, Stage: T1-T3). The negative group (PCa-) combined 24 biopsy negative (Bx-) from two institutions and 11 subjects diagnosed with rectal cancer but with no clinical or MRI indications of prostate cancer (Cl-). The boundaries of the prostate and central gland were delineated on T2w MRI by two expert raters and were used to construct statistical shape atlases for the PCa+, Bx- and Cl- prostates. An atlas comparison was performed via per-voxel statistical tests to localize shape differences (significance assessed at p < 0.05). The atlas comparison revealed central gland hypertrophy in the Bx- subpopulation, resulting in significant volume and posterior side shape differences relative to PCa+ group. Significant differences in the corresponding prostate shapes were noted at the apex when comparing the Cl- and PCa+ prostates.

Multi-atlas and unsupervised learning approach to perirectal space segmentation in CT images.

Perirectal space segmentation in computed tomography images aids in quantifying radiation dose received by healthy tissues and toxicity during the course of radiation therapy treatment of the prostate. Radiation dose normalised by tissue volume facilitates predicting outcomes or possible harmful side effects of radiation therapy treatment. Manual segmentation of the perirectal space is time consuming and challenging in the presence of inter-patient anatomical variability and may suffer from inter- and intra-observer variabilities. However automatic or semi-automatic segmentation of the perirectal space in CT images is a challenging task due to inter patient anatomical variability, contrast variability and imaging artifacts. In the model presented here, a volume of interest is obtained in a multi-atlas based segmentation approach. Un-supervised learning in the volume of interest with a Gaussian-mixture-modeling based clustering approach is adopted to achieve a soft segmentation of the perirectal space. Probabilities from soft clustering are further refined by rigid registration of the multi-atlas mask in a probabilistic domain. A maximum a posteriori approach is adopted to achieve a binary segmentation from the refined probabilities. A mean volume similarity value of 97% and a mean surface difference of 3.06 ± 0.51 mm is achieved in a leave-one-patient-out validation framework with a subset of a clinical trial dataset. Qualitative results show a good approximation of the perirectal space volume compared to the ground truth.