Lack of evidence for predictive utility from resting state fMRI data for individual exposure-based cognitive behavioral therapy outcomes: A machine learning study in two large multi-site samples in anxiety disorders.

Data-based predictions of individual Cognitive Behavioral Therapy (CBT) treatment response are a fundamental step towards precision medicine. Past studies demonstrated only moderate prediction accuracy (i.e. ability to discriminate between responders and non-responders of a given treatment) when using clinical routine data such as demographic and questionnaire data, while neuroimaging data achieved superior prediction accuracy. However, these studies may be considerably biased due to very limited sample sizes and bias-prone methodology. Adequately powered and cross-validated samples are a prerequisite to evaluate predictive performance and to identify the most promising predictors. We therefore analyzed resting state functional magnet resonance imaging (rs-fMRI) data from two large clinical trials to test whether functional neuroimaging data continues to provide good prediction accuracy in much larger samples. Data came from two distinct German multicenter studies on exposure-based CBT for anxiety disorders, the Protect-AD and SpiderVR studies. We separately and independently preprocessed baseline rs-fMRI data from n = 220 patients (Protect-AD) and n = 190 patients (SpiderVR) and extracted a variety of features, including ROI-to-ROI and edge-functional connectivity, sliding-windows, and graph measures. Including these features in sophisticated machine learning pipelines, we found that predictions of individual outcomes never significantly differed from chance level, even when conducting a range of exploratory post-hoc analyses. Moreover, resting state data never provided prediction accuracy beyond the sociodemographic and clinical data. The analyses were independent of each other in terms of selecting methods to process resting state data for prediction input as well as in the used parameters of the machine learning pipelines, corroborating the external validity of the results. These similar findings in two independent studies, analyzed separately, urge caution regarding the interpretation of promising prediction results based on neuroimaging data from small samples and emphasizes that some of the prediction accuracies from previous studies may result from overestimation due to homogeneous data and weak cross-validation schemes. The promise of resting-state neuroimaging data to play an important role in the prediction of CBT treatment outcomes in patients with anxiety disorders remains yet to be delivered.

Association between resting-state connectivity patterns in the defensive system network and treatment response in spider phobia-a replication approach.

Although highly effective on average, exposure-based treatments do not work equally well for all patients with anxiety disorders. The identification of pre-treatment response-predicting patient characteristics may enable patient stratification. Preliminary research highlights the relevance of inhibitory fronto-limbic networks as such. We aimed to identify pre-treatment neural signatures differing between exposure treatment responders and non-responders in spider phobia and to validate results through rigorous replication. Data of a bi-centric intervention study comprised clinical phenotyping and pre-treatment resting-state functional connectivity (rsFC) data of n = 79 patients with spider phobia (discovery sample) and n = 69 patients (replication sample). RsFC data analyses were accomplished using the Matlab-based CONN-toolbox with harmonized analyses protocols at both sites. Treatment response was defined by a reduction of >30% symptom severity from pre- to post-treatment (Spider Phobia Questionnaire Score, primary outcome). Secondary outcome was defined by a reduction of >50% in a Behavioral Avoidance Test (BAT). Mean within-session fear reduction functioned as a process measure for exposure. Compared to non-responders and pre-treatment, results in the discovery sample seemed to indicate that responders exhibited stronger negative connectivity between frontal and limbic structures and were characterized by heightened connectivity between the amygdala and ventral visual pathway regions. Patients exhibiting high within-session fear reduction showed stronger excitatory connectivity within the prefrontal cortex than patients with low within-session fear reduction. Whereas these results could be replicated by another team using the same data (cross-team replication), cross-site replication of the discovery sample findings in the independent replication sample was unsuccessful. Results seem to support negative fronto-limbic connectivity as promising ingredient to enhance response rates in specific phobia but lack sufficient replication. Further research is needed to obtain a valid basis for clinical decision-making and the development of individually tailored treatment options. Notably, future studies should regularly include replication approaches in their protocols.