Brain MRI Deep Learning and Bayesian Inference System Augments Radiology Resident Performance.

Automated quantitative and probabilistic medical image analysis has the potential to improve the accuracy and efficiency of the radiology workflow. We sought to determine whether AI systems for brain MRI diagnosis could be used as a clinical decision support tool to augment radiologist performance. We utilized previously developed AI systems that combine convolutional neural networks and expert-derived Bayesian networks to distinguish among 50 diagnostic entities on multimodal brain MRIs. We tested whether these systems could augment radiologist performance through an interactive clinical decision support tool known as Adaptive Radiology Interpretation and Education System (ARIES) in 194 test cases. Four radiology residents and three academic neuroradiologists viewed half of the cases unassisted and half with the results of the AI system displayed on ARIES. Diagnostic accuracy of radiologists for top diagnosis (TDx) and top three differential diagnosis (T3DDx) was compared with and without ARIES. Radiology resident performance was significantly better with ARIES for both TDx (55% vs 30%; P < .001) and T3DDx (79% vs 52%; P = 0.002), with the largest improvement for rare diseases (39% increase for T3DDx; P < 0.001). There was no significant difference between attending performance with and without ARIES for TDx (72% vs 69%; P = 0.48) or T3DDx (86% vs 89%; P = 0.39). These findings suggest that a hybrid deep learning and Bayesian inference clinical decision support system has the potential to augment diagnostic accuracy of non-specialists to approach the level of subspecialists for a large array of diseases on brain MRI.

Histopathology-validated machine learning radiographic biomarker for noninvasive discrimination between true progression and pseudo-progression in glioblastoma.

BACKGROUND: Imaging of glioblastoma patients after maximal safe resection and chemoradiation commonly demonstrates new enhancements that raise concerns about tumor progression. However, in 30% to 50% of patients, these enhancements primarily represent the effects of treatment, or pseudo-progression (PsP). We hypothesize that quantitative machine learning analysis of clinically acquired multiparametric magnetic resonance imaging (mpMRI) can identify subvisual imaging characteristics to provide robust, noninvasive imaging signatures that can distinguish true progression (TP) from PsP. METHODS: We evaluated independent discovery (n = 40) and replication (n = 23) cohorts of glioblastoma patients who underwent second resection due to progressive radiographic changes suspicious for recurrence. Deep learning and conventional feature extraction methods were used to extract quantitative characteristics from the mpMRI scans. Multivariate analysis of these features revealed radiophenotypic signatures distinguishing among TP, PsP, and mixed response that compared with similar categories blindly defined by board-certified neuropathologists. Additionally, interinstitutional validation was performed on 20 new patients. RESULTS: Patients who demonstrate TP on neuropathology are significantly different (P < .0001) from those with PsP, showing imaging features reflecting higher angiogenesis, higher cellularity, and lower water concentration. The accuracy of the proposed signature in leave-one-out cross-validation was 87% for predicting PsP (area under the curve [AUC], 0.92) and 84% for predicting TP (AUC, 0.83), whereas in the discovery/replication cohort, the accuracy was 87% for predicting PsP (AUC, 0.84) and 78% for TP (AUC, 0.80). The accuracy in the interinstitutional cohort was 75% (AUC, 0.80). CONCLUSION: Quantitative mpMRI analysis via machine learning reveals distinctive noninvasive signatures of TP versus PsP after treatment of glioblastoma. Integration of the proposed method into clinical studies can be performed using the freely available Cancer Imaging Phenomics Toolkit.

Artificial Intelligence System Approaching Neuroradiologist-level Differential Diagnosis Accuracy at Brain MRI.

Background Although artificial intelligence (AI) shows promise across many aspects of radiology, the use of AI to create differential diagnoses for rare and common diseases at brain MRI has not been demonstrated. Purpose To evaluate an AI system for generation of differential diagnoses at brain MRI compared with radiologists. Materials and Methods This retrospective study tested performance of an AI system for probabilistic diagnosis in patients with 19 common and rare diagnoses at brain MRI acquired between January 2008 and January 2018. The AI system combines data-driven and domain-expertise methodologies, including deep learning and Bayesian networks. First, lesions were detected by using deep learning. Then, 18 quantitative imaging features were extracted by using atlas-based coregistration and segmentation. Third, these image features were combined with five clinical features by using Bayesian inference to develop probability-ranked differential diagnoses. Quantitative feature extraction algorithms and conditional probabilities were fine-tuned on a training set of 86 patients (mean age, 49 years ± 16 [standard deviation]; 53 women). Accuracy was compared with radiology residents, general radiologists, neuroradiology fellows, and academic neuroradiologists by using accuracy of top one, top two, and top three differential diagnoses in 92 independent test set patients (mean age, 47 years ± 18; 52 women). Results For accuracy of top three differential diagnoses, the AI system (91% correct) performed similarly to academic neuroradiologists (86% correct; P = .20), and better than radiology residents (56%; P < .001), general radiologists (57%; P < .001), and neuroradiology fellows (77%; P = .003). The performance of the AI system was not affected by disease prevalence (93% accuracy for common vs 85% for rare diseases; P = .26). Radiologists were more accurate at diagnosing common versus rare diagnoses (78% vs 47% across all radiologists; P < .001). Conclusion An artificial intelligence system for brain MRI approached overall top one, top two, and top three differential diagnoses accuracy of neuroradiologists and exceeded that of less-specialized radiologists. © RSNA, 2020 Online supplemental material is available for this article. See also the editorial by Zaharchuk in this issue.

Emerging Applications of Artificial Intelligence in Neuro-Oncology.

Due to the exponential growth of computational algorithms, artificial intelligence (AI) methods are poised to improve the precision of diagnostic and therapeutic methods in medicine. The field of radiomics in neuro-oncology has been and will likely continue to be at the forefront of this revolution. A variety of AI methods applied to conventional and advanced neuro-oncology MRI data can already delineate infiltrating margins of diffuse gliomas, differentiate pseudoprogression from true progression, and predict recurrence and survival better than methods used in daily clinical practice. Radiogenomics will also advance our understanding of cancer biology, allowing noninvasive sampling of the molecular environment with high spatial resolution and providing a systems-level understanding of underlying heterogeneous cellular and molecular processes. By providing in vivo markers of spatial and molecular heterogeneity, these AI-based radiomic and radiogenomic tools have the potential to stratify patients into more precise initial diagnostic and therapeutic pathways and enable better dynamic treatment monitoring in this era of personalized medicine. Although substantial challenges remain, radiologic practice is set to change considerably as AI technology is further developed and validated for clinical use.

A Roadmap for Foundational Research on Artificial Intelligence in Medical Imaging: From the 2018 NIH/RSNA/ACR/The Academy Workshop.

Imaging research laboratories are rapidly creating machine learning systems that achieve expert human performance using open-source methods and tools. These artificial intelligence systems are being developed to improve medical image reconstruction, noise reduction, quality assurance, triage, segmentation, computer-aided detection, computer-aided classification, and radiogenomics. In August 2018, a meeting was held in Bethesda, Maryland, at the National Institutes of Health to discuss the current state of the art and knowledge gaps and to develop a roadmap for future research initiatives. Key research priorities include: 1, new image reconstruction methods that efficiently produce images suitable for human interpretation from source data; 2, automated image labeling and annotation methods, including information extraction from the imaging report, electronic phenotyping, and prospective structured image reporting; 3, new machine learning methods for clinical imaging data, such as tailored, pretrained model architectures, and federated machine learning methods; 4, machine learning methods that can explain the advice they provide to human users (so-called explainable artificial intelligence); and 5, validated methods for image de-identification and data sharing to facilitate wide availability of clinical imaging data sets. This research roadmap is intended to identify and prioritize these needs for academic research laboratories, funding agencies, professional societies, and industry.

Segmentation of pre- and posttreatment diffuse glioma tissue subregions including resection cavities.

Background: Evaluating longitudinal changes in gliomas is a time-intensive process with significant interrater variability. Automated segmentation could reduce interrater variability and increase workflow efficiency for assessment of treatment response. We sought to evaluate whether neural networks would be comparable to expert assessment of pre- and posttreatment diffuse gliomas tissue subregions including resection cavities. Methods: A retrospective cohort of 647 MRIs of patients with diffuse gliomas (average 55.1 years; 29%/36%/34% female/male/unknown; 396 pretreatment and 251 posttreatment, median 237 days post-surgery) from 7 publicly available repositories in The Cancer Imaging Archive were split into training (536) and test/generalization (111) samples. T1, T1-post-contrast, T2, and FLAIR images were used as inputs into a 3D nnU-Net to predict 3 tumor subregions and resection cavities. We evaluated the performance of networks trained on pretreatment training cases (Pre-Rx network), posttreatment training cases (Post-Rx network), and both pre- and posttreatment cases (Combined networks). Results: Segmentation performance was as good as or better than interrater reliability with median dice scores for main tumor subregions ranging from 0.82 to 0.94 and strong correlations between manually segmented and predicted total lesion volumes (0.94 < R 2 values < 0.98). The Combined network performed similarly to the Pre-Rx network on pretreatment cases and the Post-Rx network on posttreatment cases with fewer false positive resection cavities (7% vs 59%). Conclusions: Neural networks that accurately segment pre- and posttreatment diffuse gliomas have the potential to improve response assessment in clinical trials and reduce provider burden and errors in measurement.

The University of California San Francisco Adult Longitudinal Post-Treatment Diffuse Glioma MRI Dataset.

Supplemental material is available for this article.

The University of California San Francisco Brain Metastases Stereotactic Radiosurgery (UCSF-BMSR) MRI Dataset.

Supplemental material is available for this article.

Deep Learning Segmentation of Infiltrative and Enhancing Cellular Tumor at Pre- and Posttreatment Multishell Diffusion MRI of Glioblastoma.

Purpose To develop and validate a deep learning (DL) method to detect and segment enhancing and nonenhancing cellular tumor on pre- and posttreatment MRI scans in patients with glioblastoma and to predict overall survival (OS) and progression-free survival (PFS). Materials and Methods This retrospective study included 1397 MRI scans in 1297 patients with glioblastoma, including an internal set of 243 MRI scans (January 2010 to June 2022) for model training and cross-validation and four external test cohorts. Cellular tumor maps were segmented by two radiologists on the basis of imaging, clinical history, and pathologic findings. Multimodal MRI data with perfusion and multishell diffusion imaging were inputted into a nnU-Net DL model to segment cellular tumor. Segmentation performance (Dice score) and performance in distinguishing recurrent tumor from posttreatment changes (area under the receiver operating characteristic curve [AUC]) were quantified. Model performance in predicting OS and PFS was assessed using Cox multivariable analysis. Results A cohort of 178 patients (mean age, 56 years ± 13 [SD]; 116 male, 62 female) with 243 MRI timepoints, as well as four external datasets with 55, 70, 610, and 419 MRI timepoints, respectively, were evaluated. The median Dice score was 0.79 (IQR, 0.53-0.89), and the AUC for detecting residual or recurrent tumor was 0.84 (95% CI: 0.79, 0.89). In the internal test set, estimated cellular tumor volume was significantly associated with OS (hazard ratio [HR] = 1.04 per milliliter; P < .001) and PFS (HR = 1.04 per milliliter; P < .001) after adjustment for age, sex, and gross total resection (GTR) status. In the external test sets, estimated cellular tumor volume was significantly associated with OS (HR = 1.01 per milliliter; P < .001) after adjustment for age, sex, and GTR status. Conclusion A DL model incorporating advanced imaging could accurately segment enhancing and nonenhancing cellular tumor, distinguish recurrent or residual tumor from posttreatment changes, and predict OS and PFS in patients with glioblastoma. Keywords: Segmentation, Glioblastoma, Multishell Diffusion MRI Supplemental material is available for this article. © RSNA, 2024.

The RSNA Abdominal Traumatic Injury CT (RATIC) Dataset.

"Just Accepted" papers have undergone full peer review and have been accepted for publication in Radiology: Artificial Intelligence. This article will undergo copyediting, layout, and proof review before it is published in its final version. Please note that during production of the final copyedited article, errors may be discovered which could affect the content. The RSNA Abdominal Traumatic Injury CT (RATIC) dataset contains 4,274 abdominal CT studies with annotations related to traumatic injuries and is available at https://imaging.rsna.org/dataset/5 and https://www.kaggle.com/competitions/rsna-2023-abdominal-trauma-detection. ©RSNA, 2024.

The Brain Tumor Segmentation (BraTS) Challenge 2023: Focus on Pediatrics (CBTN-CONNECT-DIPGR-ASNR-MICCAI BraTS-PEDs).

Pediatric tumors of the central nervous system are the most common cause of cancer-related death in children. The five-year survival rate for high-grade gliomas in children is less than 20%. Due to their rarity, the diagnosis of these entities is often delayed, their treatment is mainly based on historic treatment concepts, and clinical trials require multi-institutional collaborations. The MICCAI Brain Tumor Segmentation (BraTS) Challenge is a landmark community benchmark event with a successful history of 12 years of resource creation for the segmentation and analysis of adult glioma. Here we present the CBTN-CONNECT-DIPGR-ASNR-MICCAI BraTS-PEDs 2023 challenge, which represents the first BraTS challenge focused on pediatric brain tumors with data acquired across multiple international consortia dedicated to pediatric neuro-oncology and clinical trials. The BraTS-PEDs 2023 challenge focuses on benchmarking the development of volumentric segmentation algorithms for pediatric brain glioma through standardized quantitative performance evaluation metrics utilized across the BraTS 2023 cluster of challenges. Models gaining knowledge from the BraTS-PEDs multi-parametric structural MRI (mpMRI) training data will be evaluated on separate validation and unseen test mpMRI dataof high-grade pediatric glioma. The CBTN-CONNECT-DIPGR-ASNR-MICCAI BraTS-PEDs 2023 challenge brings together clinicians and AI/imaging scientists to lead to faster development of automated segmentation techniques that could benefit clinical trials, and ultimately the care of children with brain tumors.

A multi-institutional meningioma MRI dataset for automated multi-sequence image segmentation.

Meningiomas are the most common primary intracranial tumors and can be associated with significant morbidity and mortality. Radiologists, neurosurgeons, neuro-oncologists, and radiation oncologists rely on brain MRI for diagnosis, treatment planning, and longitudinal treatment monitoring. However, automated, objective, and quantitative tools for non-invasive assessment of meningiomas on multi-sequence MR images are not available. Here we present the BraTS Pre-operative Meningioma Dataset, as the largest multi-institutional expert annotated multilabel meningioma multi-sequence MR image dataset to date. This dataset includes 1,141 multi-sequence MR images from six sites, each with four structural MRI sequences (T2-, T2/FLAIR-, pre-contrast T1-, and post-contrast T1-weighted) accompanied by expert manually refined segmentations of three distinct meningioma sub-compartments: enhancing tumor, non-enhancing tumor, and surrounding non-enhancing T2/FLAIR hyperintensity. Basic demographic data are provided including age at time of initial imaging, sex, and CNS WHO grade. The goal of releasing this dataset is to facilitate the development of automated computational methods for meningioma segmentation and expedite their incorporation into clinical practice, ultimately targeting improvement in the care of meningioma patients.

Reduced functional integration and segregation of distributed neural systems underlying social and emotional information processing in autism spectrum disorders.

A growing body of evidence suggests that autism spectrum disorders (ASDs) are related to altered communication between brain regions. Here, we present findings showing that ASD is characterized by a pattern of reduced functional integration as well as reduced segregation of large-scale brain networks. Twenty-three children with ASD and 25 typically developing matched controls underwent functional magnetic resonance imaging while passively viewing emotional face expressions. We examined whole-brain functional connectivity of two brain structures previously implicated in emotional face processing in autism: the amygdala bilaterally and the right pars opercularis of the inferior frontal gyrus (rIFGpo). In the ASD group, we observed reduced functional integration (i.e., less long-range connectivity) between amygdala and secondary visual areas, as well as reduced segregation between amygdala and dorsolateral prefrontal cortex. For the rIFGpo seed, we observed reduced functional integration with parietal cortex and increased integration with right frontal cortex as well as right nucleus accumbens. Finally, we observed reduced segregation between rIFGpo and the ventromedial prefrontal cortex. We propose that a systems-level approach-whereby the integration and segregation of large-scale brain networks in ASD is examined in relation to typical development-may provide a more detailed characterization of the neural basis of ASD.

Neuroimaging Patterns of Intracranial Infections: Meningitis, Cerebritis, and Their Complications.

Neuroimaging provides rapid, noninvasive visualization of central nervous system infections for optimal diagnosis and management. Generalizable and characteristic imaging patterns help radiologists distinguish different types of intracranial infections including meningitis and cerebritis from a variety of bacterial, viral, fungal, and/or parasitic causes. Here, we describe key radiologic patterns of meningeal enhancement and diffusion restriction through profiles of meningitis, cerebritis, abscess, and ventriculitis. We discuss various imaging modalities and recent diagnostic advances such as deep learning through a survey of intracranial pathogens and their radiographic findings. Moreover, we explore critical complications and differential diagnoses of intracranial infections.

Bayesian Networks in Radiology.

A Bayesian network is a graphical model that uses probability theory to represent relationships among its variables. The model is a directed acyclic graph whose nodes represent variables, such as the presence of a disease or an imaging finding. Connections between nodes express causal influences between variables as probability values. Bayesian networks can learn their structure (nodes and connections) and/or conditional probability values from data. Bayesian networks offer several advantages: (a) they can efficiently perform complex inferences, (b) reason from cause to effect or vice versa, (c) assess counterfactual data, (d) integrate observations with canonical ("textbook") knowledge, and (e) explain their reasoning. Bayesian networks have been employed in a wide variety of applications in radiology, including diagnosis and treatment planning. Unlike deep learning approaches, Bayesian networks have not been applied to computer vision. However, hybrid artificial intelligence systems have combined deep learning models with Bayesian networks, where the deep learning model identifies findings in medical images and the Bayesian network formulates and explains a diagnosis from those findings. One can apply a Bayesian network's probabilistic knowledge to integrate clinical and imaging findings to support diagnosis, treatment planning, and clinical decision-making. This article reviews the fundamental principles of Bayesian networks and summarizes their applications in radiology. Keywords: Bayesian Network, Machine Learning, Abdominal Imaging, Musculoskeletal Imaging, Breast Imaging, Neurologic Imaging, Radiology Education Supplemental material is available for this article. © RSNA, 2023.

3D U-Net for automated detection of multiple sclerosis lesions: utility of transfer learning from other pathologies.

Background and purpose: Deep learning algorithms for segmentation of multiple sclerosis (MS) plaques generally require training on large datasets. This manuscript evaluates the effect of transfer learning from segmentation of another pathology to facilitate use of smaller MS-specific training datasets. That is, a model trained for detection of one type of pathology was re-trained to identify MS lesions and active demyelination. Materials and methods: In this retrospective study using MRI exams from 149 patients spanning 4/18/2014 to 7/8/2021, 3D convolutional neural networks were trained with a variable number of manually-segmented MS studies. Models were trained for FLAIR lesion segmentation at a single timepoint, new FLAIR lesion segmentation comparing two timepoints, and enhancing (actively demyelinating) lesion segmentation on T1 post-contrast imaging. Models were trained either de-novo or fine-tuned with transfer learning applied to a pre-existing model initially trained on non-MS data. Performance was evaluated with lesionwise sensitivity and positive predictive value (PPV). Results: For single timepoint FLAIR lesion segmentation with 10 training studies, a fine-tuned model demonstrated improved performance [lesionwise sensitivity 0.55 ± 0.02 (mean ± standard error), PPV 0.66 ± 0.02] compared to a de-novo model (sensitivity 0.49 ± 0.02, p = 0.001; PPV 0.32 ± 0.02, p < 0.001). For new lesion segmentation with 30 training studies and their prior comparisons, a fine-tuned model demonstrated similar sensitivity (0.49 ± 0.05) and significantly improved PPV (0.60 ± 0.05) compared to a de-novo model (sensitivity 0.51 ± 0.04, p = 0.437; PPV 0.43 ± 0.04, p = 0.002). For enhancement segmentation with 20 training studies, a fine-tuned model demonstrated significantly improved overall performance (sensitivity 0.74 ± 0.06, PPV 0.69 ± 0.05) compared to a de-novo model (sensitivity 0.44 ± 0.09, p = 0.001; PPV 0.37 ± 0.05, p = 0.001). Conclusion: By fine-tuning models trained for other disease pathologies with MS-specific data, competitive models identifying existing MS plaques, new MS plaques, and active demyelination can be built with substantially smaller datasets than would otherwise be required to train new models.

The Brain Tumor Segmentation (BraTS) Challenge 2023: Glioma Segmentation in Sub-Saharan Africa Patient Population (BraTS-Africa).

Gliomas are the most common type of primary brain tumors. Although gliomas are relatively rare, they are among the deadliest types of cancer, with a survival rate of less than 2 years after diagnosis. Gliomas are challenging to diagnose, hard to treat and inherently resistant to conventional therapy. Years of extensive research to improve diagnosis and treatment of gliomas have decreased mortality rates across the Global North, while chances of survival among individuals in low- and middle-income countries (LMICs) remain unchanged and are significantly worse in Sub-Saharan Africa (SSA) populations. Long-term survival with glioma is associated with the identification of appropriate pathological features on brain MRI and confirmation by histopathology. Since 2012, the Brain Tumor Segmentation (BraTS) Challenge have evaluated state-of-the-art machine learning methods to detect, characterize, and classify gliomas. However, it is unclear if the state-of-the-art methods can be widely implemented in SSA given the extensive use of lower-quality MRI technology, which produces poor image contrast and resolution and more importantly, the propensity for late presentation of disease at advanced stages as well as the unique characteristics of gliomas in SSA (i.e., suspected higher rates of gliomatosis cerebri). Thus, the BraTS-Africa Challenge provides a unique opportunity to include brain MRI glioma cases from SSA in global efforts through the BraTS Challenge to develop and evaluate computer-aided-diagnostic (CAD) methods for the detection and characterization of glioma in resource-limited settings, where the potential for CAD tools to transform healthcare are more likely.

Frontostriatal connectivity in children during working memory and the effects of prenatal methamphetamine, alcohol, and polydrug exposure.

Various abnormalities in frontal and striatal regions have been reported in children with prenatal alcohol and/or methamphetamine exposure. In a recent fMRI study, we observed a correlation between accuracy on a working-memory task and functional activation in the putamen in children with prenatal methamphetamine and polydrug exposure. Because the putamen is part of the corticostriatal motor loop whereas the caudate is involved in the executive loop, we hypothesized that a loss of segregation between distinct corticostriatal networks may occur in these participants. The current study was designed to test this hypothesis using functional connectivity MRI. We examined 50 children ranging in age from 7 to 15, including 19 with prenatal methamphetamine exposure (15 of whom had concomitant prenatal alcohol exposure), 13 with prenatal exposure to alcohol but not methamphetamine, and 18 unexposed controls. We measured the coupling between blood oxygenation level dependent (BOLD) fluctuations during a working-memory task in four striatal seed regions and those in the rest of the brain. We found that the putamen seeds showed increased connectivity with frontal brain regions involved in executive functions while the caudate seeds showed decreased connectivity with some of these regions in both groups of exposed subjects compared to controls. These findings suggest that localized brain abnormalities resulting from prenatal exposure to alcohol and/or methamphetamine lead to a partial rewiring of corticostriatal networks. These results represent important progress in the field, and could have substantial clinical significance in helping devise more targeted treatments and remediation strategies designed to better serve the needs of this population.

Combining radiomics and deep convolutional neural network features from preoperative MRI for predicting clinically relevant genetic biomarkers in glioblastoma.

Background: Glioblastoma is the most common primary brain malignancy, yet treatment options are limited, and prognosis remains guarded. Individualized tumor genetic assessment has become important for accurate prognosis and for guiding emerging targeted therapies. However, challenges remain for widespread tumor genetic testing due to costs and the need for tissue sampling. The aim of this study is to evaluate a novel artificial intelligence method for predicting clinically relevant genetic biomarkers from preoperative brain MRI in patients with glioblastoma. Methods: We retrospectively analyzed preoperative MRI data from 400 patients with glioblastoma, IDH-wildtype or WHO grade 4 astrocytoma, IDH mutant who underwent resection and genetic testing. Nine genetic biomarkers were assessed: hotspot mutations of IDH1 or TERT promoter, pathogenic mutations of TP53, PTEN, ATRX, or CDKN2A/B, MGMT promoter methylation, EGFR amplification, and combined aneuploidy of chromosomes 7 and 10. Models were developed to predict biomarker status from MRI data using radiomics features, convolutional neural network (CNN) features, and a combination of both. Results: Combined model performance was good for IDH1 and TERT promoter hotspot mutations, pathogenic mutations of ATRX and CDKN2A/B, and combined aneuploidy of chromosomes 7 and 10, with receiver operating characteristic area under the curve (ROC AUC) >0.85 and was fair for all other tested biomarkers with ROC AUC >0.7. Combined model performance was statistically superior to individual radiomics and CNN feature models for prediction chromosome 7 and 10 aneuploidy, MGMT promoter methylation, and PTEN mutation. Conclusions: Combining radiomics and CNN features from preoperative MRI yields improved noninvasive genetic biomarker prediction performance in patients with WHO grade 4 diffuse astrocytic gliomas.

Longitudinal Assessment of Posttreatment Diffuse Glioma Tissue Volumes with Three-dimensional Convolutional Neural Networks.

Neural networks were trained for segmentation and longitudinal assessment of posttreatment diffuse glioma. A retrospective cohort (from January 2018 to December 2019) of 298 patients with diffuse glioma (mean age, 52 years ± 14 [SD]; 177 men; 152 patients with glioblastoma, 72 patients with astrocytoma, and 74 patients with oligodendroglioma) who underwent two consecutive multimodal MRI examinations were randomly selected into training (n = 198) and testing (n = 100) samples. A posttreatment tumor segmentation three-dimensional nnU-Net convolutional neural network with multichannel inputs (T1, T2, and T1 postcontrast and fluid-attenuated inversion recovery [FLAIR]) was trained to segment three multiclass tissue types (peritumoral edematous, infiltrated, or treatment-changed tissue [ED]; active tumor or enhancing tissue [AT]; and necrotic core). Separate longitudinal change nnU-Nets were trained on registered and subtracted FLAIR and T1 postlongitudinal images to localize and better quantify and classify changes in ED and AT. Segmentation Dice scores, volume similarities, and 95th percentile Hausdorff distances ranged from 0.72 to 0.89, 0.90 to 0.96, and 2.5 to 3.6 mm, respectively. Accuracy rates of the posttreatment tumor segmentation and longitudinal change networks being able to classify longitudinal changes in ED and AT as increased, decreased, or unchanged were 76%-79% and 90%-91%, respectively. The accuracy levels of the longitudinal change networks were not significantly different from those of three neuroradiologists (accuracy, 90%-92%; κ, 0.58-0.63; P > .05). The results of this study support the potential clinical value of artificial intelligence-based automated longitudinal assessment of posttreatment diffuse glioma. Keywords: MR Imaging, Neuro-Oncology, Neural Networks, CNS, Brain/Brain Stem, Segmentation, Quantification, Convolutional Neural Network (CNN) Supplemental material is available for this article. © RSNA, 2022.