Deep Generative Medical Image Harmonization for Improving Cross-Site Generalization in Deep Learning Predictors.

BACKGROUND: In the medical imaging domain, deep learning-based methods have yet to see widespread clinical adoption, in part due to limited generalization performance across different imaging devices and acquisition protocols. The deviation between estimated brain age and biological age is an established biomarker of brain health and such models may benefit from increased cross-site generalizability. PURPOSE: To develop and evaluate a deep learning-based image harmonization method to improve cross-site generalizability of deep learning age prediction. STUDY TYPE: Retrospective. POPULATION: Eight thousand eight hundred and seventy-six subjects from six sites. Harmonization models were trained using all subjects. Age prediction models were trained using 2739 subjects from a single site and tested using the remaining 6137 subjects from various other sites. FIELD STRENGTH/SEQUENCE: Brain imaging with magnetization prepared rapid acquisition with gradient echo or spoiled gradient echo sequences at 1.5 T and 3 T. ASSESSMENT: StarGAN v2, was used to perform a canonical mapping from diverse datasets to a reference domain to reduce site-based variation while preserving semantic information. Generalization performance of deep learning age prediction was evaluated using harmonized, histogram matched, and unharmonized data. STATISTICAL TESTS: Mean absolute error (MAE) and Pearson correlation between estimated age and biological age quantified the performance of the age prediction model. RESULTS: Our results indicated a substantial improvement in age prediction in out-of-sample data, with the overall MAE improving from 15.81 (±0.21) years to 11.86 (±0.11) with histogram matching to 7.21 (±0.22) years with generative adversarial network (GAN)-based harmonization. In the multisite case, across the 5 out-of-sample sites, MAE improved from 9.78 (±6.69) years to 7.74 (±3.03) years with histogram normalization to 5.32 (±4.07) years with GAN-based harmonization. DATA CONCLUSION: While further research is needed, GAN-based medical image harmonization appears to be a promising tool for improving cross-site deep learning generalization. LEVEL OF EVIDENCE: 4 TECHNICAL EFFICACY: Stage 1.

MRI signatures of brain age and disease over the lifespan based on a deep brain network and 14 468 individuals worldwide.

Deep learning has emerged as a powerful approach to constructing imaging signatures of normal brain ageing as well as of various neuropathological processes associated with brain diseases. In particular, MRI-derived brain age has been used as a comprehensive biomarker of brain health that can identify both advanced and resilient ageing individuals via deviations from typical brain ageing. Imaging signatures of various brain diseases, including schizophrenia and Alzheimer's disease, have also been identified using machine learning. Prior efforts to derive these indices have been hampered by the need for sophisticated and not easily reproducible processing steps, by insufficiently powered or diversified samples from which typical brain ageing trajectories were derived, and by limited reproducibility across populations and MRI scanners. Herein, we develop and test a sophisticated deep brain network (DeepBrainNet) using a large (n = 11 729) set of MRI scans from a highly diversified cohort spanning different studies, scanners, ages and geographic locations around the world. Tests using both cross-validation and a separate replication cohort of 2739 individuals indicate that DeepBrainNet obtains robust brain-age estimates from these diverse datasets without the need for specialized image data preparation and processing. Furthermore, we show evidence that moderately fit brain ageing models may provide brain age estimates that are most discriminant of individuals with pathologies. This is not unexpected as tightly-fitting brain age models naturally produce brain-age estimates that offer little information beyond age, and loosely fitting models may contain a lot of noise. Our results offer some experimental evidence against commonly pursued tightly-fitting models. We show that the moderately fitting brain age models obtain significantly higher differentiation compared to tightly-fitting models in two of the four disease groups tested. Critically, we demonstrate that leveraging DeepBrainNet, along with transfer learning, allows us to construct more accurate classifiers of several brain diseases, compared to directly training classifiers on patient versus healthy control datasets or using common imaging databases such as ImageNet. We, therefore, derive a domain-specific deep network likely to reduce the need for application-specific adaptation and tuning of generic deep learning networks. We made the DeepBrainNet model freely available to the community for MRI-based evaluation of brain health in the general population and over the lifespan.