Providing clinical context to the spatio-temporal analysis of 4D CT perfusion to predict acute ischemic stroke lesion outcomes.

Acute ischemic stroke is a leading cause of mortality and morbidity worldwide. Timely identification of the extent of a stroke is crucial for effective treatment, whereas spatio-temporal (4D) Computed Tomography Perfusion (CTP) imaging is playing a critical role in this process. Recently, the first deep learning-based methods that leverage the full spatio-temporal nature of perfusion imaging for predicting stroke lesion outcomes have been proposed. However, clinical information is typically not integrated into the learning process, which may be helpful to improve the tissue outcome prediction given the known influence of various factors (i.e., physiological, demographic, and treatment factors) on lesion growth. Cross-attention, a multimodal fusion strategy, has been successfully used to combine information from multiple sources, but it has yet to be applied to stroke lesion outcome prediction. Therefore, this work aimed to develop and evaluate a novel multimodal and spatio-temporal deep learning model that utilizes cross-attention to combine information from 4D CTP and clinical metadata simultaneously to predict stroke lesion outcomes. The proposed model was evaluated using a dataset of 70 acute ischemic stroke patients, demonstrating significantly improved volume estimates (mean error = 19 ml) compared to a baseline unimodal approach (mean error = 35 ml, p< 0.05). The proposed model allows generating attention maps and counterfactual outcome scenarios to investigate the relevance of clinical variables in predicting stroke lesion outcomes at a patient level, helping to provide a better understanding of the model's decision-making process.

Challenges and Potential of Artificial Intelligence in Neuroradiology.

PURPOSE: Artificial intelligence (AI) has emerged as a transformative force in medical research and is garnering increased attention in the public consciousness. This represents a critical time period in which medical researchers, healthcare providers, insurers, regulatory agencies, and patients are all developing and shaping their beliefs and policies regarding the use of AI in the healthcare sector. The successful deployment of AI will require support from all these groups. This commentary proposes that widespread support for medical AI must be driven by clear and transparent scientific reporting, beginning at the earliest stages of scientific research. METHODS: A review of relevant guidelines and literature describing how scientific reporting plays a central role at key stages in the life cycle of an AI software product was conducted. To contextualize this principle within a specific medical domain, we discuss the current state of predictive tissue outcome modeling in acute ischemic stroke and the unique challenges presented therein. RESULTS AND CONCLUSION: Translating AI methods from the research to the clinical domain is complicated by challenges related to model design and validation studies, medical product regulations, and healthcare providers' reservations regarding AI's efficacy and affordability. However, each of these limitations is also an opportunity for high-impact research that will help to accelerate the clinical adoption of state-of-the-art medical AI. In all cases, establishing and adhering to appropriate reporting standards is an important responsibility that is shared by all of the parties involved in the life cycle of a prospective AI software product.

Annotation-free prediction of treatment-specific tissue outcome from 4D CT perfusion imaging in acute ischemic stroke.

Acute ischemic stroke is a critical health condition that requires timely intervention. Following admission, clinicians typically use perfusion imaging to facilitate treatment decision-making. While deep learning models leveraging perfusion data have demonstrated the ability to predict post-treatment tissue infarction for individual patients, predictions are often represented as binary or probabilistic masks that are not straightforward to interpret or easy to obtain. Moreover, these models typically rely on large amounts of subjectively segmented data and non-standard perfusion analysis techniques. To address these challenges, we propose a novel deep learning approach that directly predicts follow-up computed tomography images from full spatio-temporal 4D perfusion scans through a temporal compression. The results show that this method leads to realistic follow-up image predictions containing the infarcted tissue outcomes. The proposed compression method achieves comparable prediction results to using perfusion maps as inputs but without the need for perfusion analysis or arterial input function selection. Additionally, separate models trained on 45 patients treated with thrombolysis and 102 treated with thrombectomy showed that each model correctly captured the different patient-specific treatment effects as shown by image difference maps. The findings of this work clearly highlight the potential of our method to provide interpretable stroke treatment decision support without requiring manual annotations.

A cross-attention-based deep learning approach for predicting functional stroke outcomes using 4D CTP imaging and clinical metadata.

Acute ischemic stroke (AIS) remains a global health challenge, leading to long-term functional disabilities without timely intervention. Spatio-temporal (4D) Computed Tomography Perfusion (CTP) imaging is crucial for diagnosing and treating AIS due to its ability to rapidly assess the ischemic core and penumbra. Although traditionally used to assess acute tissue status in clinical settings, 4D CTP has also been explored in research for predicting stroke tissue outcomes. However, its potential for predicting functional outcomes, especially in combination with clinical metadata, remains unexplored. Thus, this work aims to develop and evaluate a novel multimodal deep learning model for predicting functional outcomes (specifically, 90-day modified Rankin Scale) in AIS patients by combining 4D CTP and clinical metadata. To achieve this, an intermediate fusion strategy with a cross-attention mechanism is introduced to enable a selective focus on the most relevant features and patterns from both modalities. Evaluated on a dataset comprising 70 AIS patients who underwent endovascular mechanical thrombectomy, the proposed model achieves an accuracy (ACC) of 0.77, outperforming conventional late fusion strategies (ACC = 0.73) and unimodal models based on either 4D CTP (ACC = 0.61) or clinical metadata (ACC = 0.71). The results demonstrate the superior capability of the proposed model to leverage complex inter-modal relationships, emphasizing the value of advanced multimodal fusion techniques for predicting functional stroke outcomes.

Identifying Biases in a Multicenter MRI Database for Parkinson's Disease Classification: Is the Disease Classifier a Secret Site Classifier?

Sharing multicenter imaging datasets can be advantageous to increase data diversity and size but may lead to spurious correlations between site-related biological and non-biological image features and target labels, which machine learning (ML) models may exploit as shortcuts. To date, studies analyzing how and if deep learning models may use such effects as a shortcut are scarce. Thus, the aim of this work was to investigate if site-related effects are encoded in the feature space of an established deep learning model designed for Parkinson's disease (PD) classification based on T1-weighted MRI datasets. Therefore, all layers of the PD classifier were frozen, except for the last layer of the network, which was replaced by a linear layer that was exclusively re-trained to predict three potential bias types (biological sex, scanner type, and originating site). Our findings based on a large database consisting of 1880 MRI scans collected across 41 centers show that the feature space of the established PD model (74% accuracy) can be used to classify sex (75% accuracy), scanner type (79% accuracy), and site location (71% accuracy) with high accuracies despite this information never being explicitly provided to the PD model during original training. Overall, the results of this study suggest that trained image-based classifiers may use unwanted shortcuts that are not meaningful for the actual clinical task at hand. This finding may explain why many image-based deep learning models do not perform well when applied to data from centers not contributing to the training set.

Towards objective and systematic evaluation of bias in artificial intelligence for medical imaging.

OBJECTIVE: Artificial intelligence (AI) models trained using medical images for clinical tasks often exhibit bias in the form of subgroup performance disparities. However, since not all sources of bias in real-world medical imaging data are easily identifiable, it is challenging to comprehensively assess their impacts. In this article, we introduce an analysis framework for systematically and objectively investigating the impact of biases in medical images on AI models. MATERIALS AND METHODS: Our framework utilizes synthetic neuroimages with known disease effects and sources of bias. We evaluated the impact of bias effects and the efficacy of 3 bias mitigation strategies in counterfactual data scenarios on a convolutional neural network (CNN) classifier. RESULTS: The analysis revealed that training a CNN model on the datasets containing bias effects resulted in expected subgroup performance disparities. Moreover, reweighing was the most successful bias mitigation strategy for this setup. Finally, we demonstrated that explainable AI methods can aid in investigating the manifestation of bias in the model using this framework. DISCUSSION: The value of this framework is showcased in our findings on the impact of bias scenarios and efficacy of bias mitigation in a deep learning model pipeline. This systematic analysis can be easily expanded to conduct further controlled in silico trials in other investigations of bias in medical imaging AI. CONCLUSION: Our novel methodology for objectively studying bias in medical imaging AI can help support the development of clinical decision-support tools that are robust and responsible.

Predicting treatment-specific lesion outcomes in acute ischemic stroke from 4D CT perfusion imaging using spatio-temporal convolutional neural networks.

For the diagnosis and precise treatment of acute ischemic stroke, predicting the final location and volume of lesions is of great clinical interest. Current deep learning-based prediction methods mainly use perfusion parameter maps, which can be calculated from spatio-temporal (4D) CT perfusion (CTP) imaging data, to estimate the tissue outcome of an acute ischemic stroke. However, this calculation relies on a deconvolution operation, an ill-posed problem requiring strong regularization and definition of an arterial input function. Thus, improved predictions might be achievable if the deep learning models were applied directly to acute 4D CTP data rather than perfusion maps. In this work, a novel deep spatio-temporal convolutional neural network is proposed for predicting treatment-dependent stroke lesion outcomes by making full use of raw 4D CTP data. By merging a U-Net-like architecture with temporal convolutional networks, we efficiently process the spatio-temporal information available in CTP datasets to make a tissue outcome prediction. The proposed method was evaluated on 147 patients using a 10-fold cross validation, which demonstrated that the proposed 3D+time model (mean Dice=0.45) significantly outperforms both a 2D+time variant of our approach (mean Dice=0.43) and a state-of-the-art method that uses perfusion maps (mean Dice=0.38). These results show that 4D CTP datasets include more predictive information than perfusion parameter maps, and that the proposed method is an efficient approach to make use of this complex data.

Predicting the tissue outcome of acute ischemic stroke from acute 4D computed tomography perfusion imaging using temporal features and deep learning.

Predicting follow-up lesions from baseline CT perfusion (CTP) datasets in acute ischemic stroke patients is important for clinical decision making. Deep convolutional networks (DCNs) are assumed to be the current state-of-the-art for this task. However, many DCN classifiers have not been validated against the methods currently used in research (random decision forests, RDF) and clinical routine (Tmax thresholding). Specialized DCNs have even been designed to extract complex temporal features directly from spatiotemporal CTP data instead of using standard perfusion parameter maps. However, the benefits of applying deep learning to source or deconvolved CTP data compared to perfusion parameter maps have not been formally investigated so far. In this work, a modular UNet-based DCN is proposed that separates temporal feature extraction from tissue outcome prediction, allowing for both model validation using perfusion parameter maps as well as end-to-end learning from spatiotemporal CTP data. 145 retrospective datasets comprising baseline CTP imaging, perfusion parameter maps, and follow-up non-contrast CT with manual lesion segmentations were assembled from acute ischemic stroke patients treated with intravenous thrombolysis alone (IV; n = 43) or intra-arterial mechanical thrombectomy (IA; n = 102) with or without combined IV. Using the perfusion parameter maps as input, the proposed DCN (mean Dice: 0.287) outperformed the RDF (0.262) and simple Tmax-thresholding (0.249). The performance of the proposed DCN was approximately equal using features optimized from the deconvolved residual curves (0.286) compared to perfusion parameter maps (0.287), while using features optimized from the source concentration-time curves (0.296) provided the best tissue outcome predictions.

Perfusion Changes in Acute Stroke Treated with Theophylline as an Add-on to Thrombolysis : A Randomized Clinical Trial Subgroup Analysis.

PURPOSE: Theophylline has been suggested to have a neuroprotective effect in ischemic stroke; however, results from animal stroke models and clinical trials in humans are controversial. The aim of this study was to assess the effect of theophylline on the cerebral perfusion with multiparametric magnetic resonance imaging (MRI). METHODS: The relative cerebral blood flow (rCBF), relative cerebral blood volume (rCBV), and relative mean transit time (rMTT) in the infarct core, penumbra, and unaffected tissue were measured using multi-parametric MRI at baseline and 3­h follow-up in patients treated with theophylline or placebo as an add-on to thrombolytic therapy. RESULTS: No significant differences in mean rCBF, rCBV, and rMTT was found in the penumbra and unaffected tissue between the theophylline group and the control group between baseline and 3­h follow-up. In the infarct core, mean rCBV increased on average by 0.05 in the theophylline group and decreased by 0.14 in the control group (p < 0.04). Mean rCBF and mean rMTT in the infarct core were similar between the two treatment groups. CONCLUSION: The results indicate that theophylline does not change the perfusion in potentially salvageable penumbral tissue but only affects the rCBV in the infarct core. In contrast to the penumbra, the infarct core is unlikely to be salvageable, which might explain why theophylline failed in clinical trials.

Treatment Efficacy Analysis in Acute Ischemic Stroke Patients Using In Silico Modeling Based on Machine Learning: A Proof-of-Principle.

Interventional neuroradiology is characterized by engineering- and experience-driven device development with design improvements every few months. However, clinical validation of these new devices requires lengthy and expensive randomized controlled trials. This contribution proposes a machine learning-based in silico study design to evaluate new devices more quickly with a small sample size. Acute diffusion- and perfusion-weighted MRI, segmented one-week follow-up imaging, and clinical variables were available for 90 acute ischemic stroke patients. Three treatment option-specific random forest models were trained to predict the one-week follow-up lesion segmentation for (1) patients successfully recanalized using intra-arterial mechanical thrombectomy, (2) patients successfully recanalized using intravenous thrombolysis, and (3) non-recanalizing patients as an analogue for conservative treatment for each patient in the sample, independent of the true group membership. A repeated-measures analysis of the three predicted follow-up lesions for each patient revealed significantly larger lesions for the non-recanalizing group compared to the successful intravenous thrombolysis treatment group, which in turn showed significantly larger lesions compared to the successful mechanical thrombectomy treatment group (p < 0.001). A groupwise comparison of the true follow-up lesions for the three treatment options showed the same trend but did not reach statistical significance (p = 0.19). We conclude that the proposed machine learning-based in silico trial design leads to clinically feasible results and can support new efficacy studies by providing additional power and potential early intermediate results.

Machine Learning-Based Prediction of Brain Tissue Infarction in Patients With Acute Ischemic Stroke Treated With Theophylline as an Add-On to Thrombolytic Therapy: A Randomized Clinical Trial Subgroup Analysis.

Background and Purpose: The theophylline in acute ischemic stroke trial investigated the neuroprotective effect of theophylline as an add-on to thrombolytic therapy in patients with acute ischemic stroke. The aim of this pre-planned subgroup analysis was to use predictive modeling to virtually test for differences in the follow-up lesion volumes. Materials and Methods: A subgroup of 52 patients from the theophylline in acute ischemic stroke trial with multi-parametric MRI data acquired at baseline and at 24-h follow-up were analyzed. A machine learning model using voxel-by-voxel information from diffusion- and perfusion-weighted MRI and clinical parameters was used to predict the infarct volume for each individual patient and both treatment arms. After training of the two predictive models, two virtual lesion outcomes were available for each patient, one lesion predicted for theophylline treatment and one lesion predicted for placebo treatment. Results: The mean predicted volume of follow-up lesions was 11.4 ml (standard deviation 18.7) for patients virtually treated with theophylline and 11.2 ml (standard deviation 17.3) for patients virtually treated with placebo (p = 0.86). Conclusions: The predicted follow-up brain lesions for each patient were not significantly different for patients virtually treated with theophylline or placebo, as an add-on to thrombolytic therapy. Thus, this study confirmed the lack of neuroprotective effect of theophylline shown in the main clinical trial and is contrary to the results from preclinical stroke models.

Automatic arterial input function selection in CT and MR perfusion datasets using deep convolutional neural networks.

PURPOSE: The computation of perfusion parameter images requires knowledge of the arterial blood flow in the form of an arterial input function (AIF). This work proposes a novel method to automatically identify AIFs in computed tomography perfusion (CTP) and dynamic susceptibility contrast perfusion-weighted MRI (PWI) datasets using a deep convolutional neural network (CNN). METHODS: One-hundred CTP and 100 PWI datasets of acute ischemic stroke patients were available for model development and evaluation. For each modality, 50 datasets were used for CNN training and 20 for validation using manually selected AIFs and non-arterial tissue concentration time curves. Model evaluation was performed using the remaining 30 independent validation datasets from each modality with manual AIF selections provided by two experts as ground truth. Additionally, AIFs were also extracted using an established automatic shape-based algorithm for comparison purposes. The extracted AIFs were compared using normalized cross-correlation and shape features as well as using the Dice similarity metric and volume of the corresponding hypoperfusion (Tmax > 6 s) lesions. RESULTS: The cross-correlation values comparing the manual AIFs and those extracted by the proposed CNN method were significantly greater than those comparing the manual AIFs to the shape-based comparison method. Likewise, hypoperfusion lesions generated using the manually selected AIFs and CNN-based AIFs showed higher Dice values compared to hypoperfusion lesions generated using the comparison AIF extraction method. Shape features for AIFs generated by the proposed method did not differ significantly from the manual AIFs, with the exception that the CNN-derived AIFs for the PWI datasets showed marginally greater peak heights. CONCLUSION: Deep convolutional neural network models are viable for the automatic extraction of the AIF from CTP and PWI datasets.

Supervised machine learning tools: a tutorial for clinicians.

In an increasingly data-driven world, artificial intelligence is expected to be a key tool for converting big data into tangible benefits and the healthcare domain is no exception to this. Machine learning aims to identify complex patterns in multi-dimensional data and use these uncovered patterns to classify new unseen cases or make data-driven predictions. In recent years, deep neural networks have shown to be capable of producing results that considerably exceed those of conventional machine learning methods for various classification and regression tasks. In this paper, we provide an accessible tutorial of the most important supervised machine learning concepts and methods, including deep learning, which are potentially the most relevant for the medical domain. We aim to take some of the mystery out of machine learning and depict how machine learning models can be useful for medical applications. Finally, this tutorial provides a few practical suggestions for how to properly design a machine learning model for a generic medical problem.

Technical considerations of multi-parametric tissue outcome prediction methods in acute ischemic stroke patients.

Decisions regarding acute stroke treatment rely heavily on imaging, but interpretation can be difficult for physicians. Machine learning methods can assist clinicians by providing tissue outcome predictions for different treatment approaches based on acute multi-parametric imaging. To produce such clinically viable machine learning models, factors such as classifier choice, data normalization, and data balancing must be considered. This study gives comprehensive consideration to these factors by comparing the agreement of voxel-based tissue outcome predictions using acute imaging and clinical parameters with manual lesion segmentations derived from follow-up imaging. This study considers random decision forest, generalized linear model, and k-nearest-neighbor machine learning classifiers in conjunction with three data normalization approaches (non-normalized, relative to contralateral hemisphere, and relative to contralateral VOI), and two data balancing strategies (full dataset and stratified subsampling). These classifier settings were evaluated based on 90 MRI datasets from acute ischemic stroke patients. Distinction was made between patients recanalized using intraarterial and intravenous methods, as well as those without successful recanalization. For primary quantitative comparison, the Dice metric was computed for each voxel-based tissue outcome prediction and its corresponding follow-up lesion segmentation. It was found that the random forest classifier outperformed the generalized linear model and the k-nearest-neighbor classifier, that normalization did not improve the Dice score of the lesion outcome predictions, and that the models generated lesion outcome predictions with higher Dice scores when trained with balanced datasets. No significant difference was found between the treatment groups (intraarterial vs intravenous) regarding the Dice score of the tissue outcome predictions.