Tractography reproducibility challenge with empirical data (TraCED): The 2017 ISMRM diffusion study group challenge.

BACKGROUND: Fiber tracking with diffusion-weighted MRI has become an essential tool for estimating in vivo brain white matter architecture. Fiber tracking results are sensitive to the choice of processing method and tracking criteria. PURPOSE: To assess the variability for an algorithm in group studies reproducibility is of critical context. However, reproducibility does not assess the validity of the brain connections. Phantom studies provide concrete quantitative comparisons of methods relative to absolute ground truths, yet do no capture variabilities because of in vivo physiological factors. The ISMRM 2017 TraCED challenge was created to fulfill the gap. STUDY TYPE: A systematic review of algorithms and tract reproducibility studies. SUBJECTS: Single healthy volunteers. FIELD STRENGTH/SEQUENCE: 3.0T, two different scanners by the same manufacturer. The multishell acquisition included b-values of 1000, 2000, and 3000 s/mm2 with 20, 45, and 64 diffusion gradient directions per shell, respectively. ASSESSMENT: Nine international groups submitted 46 tractography algorithm entries each consisting 16 tracts per scan. The algorithms were assessed using intraclass correlation (ICC) and the Dice similarity measure. STATISTICAL TESTS: Containment analysis was performed to assess if the submitted algorithms had containment within tracts of larger volume submissions. This also serves the purpose to detect if spurious submissions had been made. RESULTS: The top five submissions had high ICC and Dice >0.88. Reproducibility was high within the top five submissions when assessed across sessions or across scanners: 0.87-0.97. Containment analysis shows that the top five submissions are contained within larger volume submissions. From the total of 16 tracts as an outcome relatively the number of tracts with high, moderate, and low reproducibility were 8, 4, and 4. DATA CONCLUSION: The different methods clearly result in fundamentally different tract structures at the more conservative specificity choices. Data and challenge infrastructure remain available for continued analysis and provide a platform for comparison. LEVEL OF EVIDENCE: 5 Technical Efficacy Stage: 1 J. Magn. Reson. Imaging 2020;51:234-249.

Bundle-specific tractography with incorporated anatomical and orientational priors.

Anatomical white matter bundles vary in shape, size, length, and complexity, making diffusion MRI tractography reconstruction of some bundles more difficult than others. As a result, bundles reconstruction often suffers from a poor spatial extent recovery. To fill-up the white matter volume as much and as best as possible, millions of streamlines can be generated and filtering techniques applied to address this issue. However, well-known problems and biases are introduced such as the creation of a large number of false positives and over-representation of easy-to-track parts of bundles and under-representation of hard-to-track. To address these challenges, we developed a Bundle-Specific Tractography (BST) algorithm. It incorporates anatomical and orientational prior knowledge during the process of streamline tracing to increase reproducibility, sensitivity, specificity and efficiency when reconstructing certain bundles of interest. BST outperforms classical deterministic, probabilistic, and global tractography methods. The increase in anatomically plausible streamlines, with larger spatial coverage, helps to accurately represent the full shape of bundles, which could greatly enhance and robustify tract-based and connectivity-based neuroimaging studies.

Limits to anatomical accuracy of diffusion tractography using modern approaches.

Diffusion MRI fiber tractography is widely used to probe the structural connectivity of the brain, with a range of applications in both clinical and basic neuroscience. Despite widespread use, tractography has well-known pitfalls that limits the anatomical accuracy of this technique. Numerous modern methods have been developed to address these shortcomings through advances in acquisition, modeling, and computation. To test whether these advances improve tractography accuracy, we organized the 3-D Validation of Tractography with Experimental MRI (3D-VoTEM) challenge at the ISBI 2018 conference. We made available three unique independent tractography validation datasets - a physical phantom and two ex vivo brain specimens - resulting in 176 distinct submissions from 9 research groups. By comparing results over a wide range of fiber complexities and algorithmic strategies, this challenge provides a more comprehensive assessment of tractography's inherent limitations than has been reported previously. The central results were consistent across all sub-challenges in that, despite advances in tractography methods, the anatomical accuracy of tractography has not dramatically improved in recent years. Taken together, our results independently confirm findings from decades of tractography validation studies, demonstrate inherent limitations in reconstructing white matter pathways using diffusion MRI data alone, and highlight the need for alternative or combinatorial strategies to accurately map the fiber pathways of the brain.

Recognition of white matter bundles using local and global streamline-based registration and clustering.

Virtual dissection of diffusion MRI tractograms is cumbersome and needs extensive knowledge of white matter anatomy. This virtual dissection often requires several inclusion and exclusion regions-of-interest that make it a process that is very hard to reproduce across experts. Having automated tools that can extract white matter bundles for tract-based studies of large numbers of people is of great interest for neuroscience and neurosurgical planning. The purpose of our proposed method, named RecoBundles, is to segment white matter bundles and make virtual dissection easier to perform. This can help explore large tractograms from multiple persons directly in their native space. RecoBundles leverages latest state-of-the-art streamline-based registration and clustering to recognize and extract bundles using prior bundle models. RecoBundles uses bundle models as shape priors for detecting similar streamlines and bundles in tractograms. RecoBundles is 100% streamline-based, is efficient to work with millions of streamlines and, most importantly, is robust and adaptive to incomplete data and bundles with missing components. It is also robust to pathological brains with tumors and deformations. We evaluated our results using multiple bundles and showed that RecoBundles is in good agreement with the neuroanatomical experts and generally produced more dense bundles. Across all the different experiments reported in this paper, RecoBundles was able to identify the core parts of the bundles, independently from tractography type (deterministic or probabilistic) or size. Thus, RecoBundles can be a valuable method for exploring tractograms and facilitating tractometry studies.

A system of feed-forward cerebellar circuits that extend and diversify sensory signaling.

Sensory signals are processed by the cerebellum to coordinate movements. Numerous cerebellar functions are thought to require the maintenance of a sensory representation that extends beyond the input signal. Granule cells receive sensory input, but they do not prolong the signal and are thus unlikely to maintain a sensory representation for much longer than the inputs themselves. Unipolar brush cells (UBCs) are excitatory interneurons that project to granule cells and transform sensory input into prolonged increases or decreases in firing, depending on their ON or OFF UBC subtype. Further extension and diversification of the input signal could be produced by UBCs that project to one another, but whether this circuitry exists is unclear. Here we test whether UBCs innervate one another and explore how these small networks of UBCs could transform spiking patterns. We characterized two transgenic mouse lines electrophysiologically and immunohistochemically to confirm that they label ON and OFF UBC subtypes and crossed them together, revealing that ON and OFF UBCs innervate one another. A Brainbow reporter was used to label UBCs of the same ON or OFF subtype with different fluorescent proteins, which showed that UBCs innervate their own subtypes as well. Computational models predict that these feed-forward networks of UBCs extend the length of bursts or pauses and introduce delays-transformations that may be necessary for cerebellar functions from modulation of eye movements to adaptive learning across time scales.

A system of feed-forward cerebellar circuits that extend and diversify sensory signaling.

Sensory signals are processed by the cerebellum to coordinate movements. Numerous cerebellar functions are thought to require the maintenance of a sensory representation that extends beyond the input signal. Granule cells receive sensory input, but they do not prolong the signal and are thus unlikely to maintain a sensory representation for much longer than the inputs themselves. Unipolar brush cells (UBCs) are excitatory interneurons that project to granule cells and transform sensory input into prolonged increases or decreases in firing, depending on their ON or OFF UBC subtype. Further extension and diversification of the input signal could be produced by UBCs that project to one another, but whether this circuitry exists is unclear. Here we test whether UBCs innervate one another and explore how these small networks of UBCs could transform spiking patterns. We characterized two transgenic mouse lines electrophysiologically and immunohistochemically to confirm that they label ON and OFF UBC subtypes and crossed them together, revealing that ON and OFF UBCs innervate one another. A Brainbow reporter was used to label UBCs of the same ON or OFF subtype with different fluorescent proteins, which showed that UBCs innervate their own subtypes as well. Computational models predict that these feed-forward networks of UBCs extend the length of bursts or pauses and introduce delays-transformations that may be necessary for cerebellar functions from modulation of eye movements to adaptive learning across time scales.

Structural Connectivity Alterations in Operculo-Insular Epilepsy.

Operculo-insular epilepsy (OIE) is an under-recognized condition that can mimic temporal and extratemporal epilepsies. Previous studies have revealed structural connectivity changes in the epileptic network of focal epilepsy. However, most reports use the debated streamline-count to quantify 'connectivity strength' and rely on standard tracking algorithms. We propose a sophisticated cutting-edge method that is robust to crossing fibers, optimizes cortical coverage, and assigns an accurate microstructure-reflecting quantitative conectivity marker, namely the COMMIT (Convex Optimization Modeling for Microstructure Informed Tractography)-weight. Using our pipeline, we report the connectivity alterations in OIE. COMMIT-weighted matrices were created in all participants (nine patients with OIE, eight patients with temporal lobe epilepsy (TLE), and 22 healthy controls (HC)). In the OIE group, widespread increases in 'connectivity strength' were observed bilaterally. In OIE patients, 'hyperconnections' were observed between the insula and the pregenual cingulate gyrus (OIE group vs. HC group) and between insular subregions (OIE vs. TLE). Graph theoretic analyses revealed higher connectivity within insular subregions of OIE patients (OIE vs. TLE). We reveal, for the first time, the structural connectivity distribution in OIE. The observed pattern of connectivity in OIE likely reflects a diffuse epileptic network incorporating insular-connected regions and may represent a structural signature and diagnostic biomarker.

The role of diffusion tractography in refining glial tumor resection.

Primary brain tumors are notoriously hard to resect surgically. Due to their infiltrative nature, finding the optimal resection boundary without damaging healthy tissue can be challenging. One potential tool to help make this decision is diffusion-weighted magnetic resonance imaging (dMRI) tractography. dMRI exploits the diffusion of water molecule along axons to generate a 3D modelization of the white matter bundles in the brain. This feature is particularly useful to visualize how a tumor affects its surrounding white matter and plan a surgical path. This paper reviews the different ways in which dMRI can be used to improve brain tumor resection, its benefits and also its limitations. We expose surgical tools that can be paired with dMRI to improve its impact on surgical outcome, such as loading the 3D tractography in the neuronavigation system and direct electrical stimulation to validate the position of the white matter bundles of interest. We also review articles validating dMRI findings using other anatomical investigation techniques, such as postmortem dissections, manganese-enhanced MRI, electrophysiological stimulations, and phantom studies with known ground truth. We will be discussing the areas of the brain where dMRI performs well and where the future challenges are. We will conclude this review with suggestions and take home messages for neurosurgeons, tractographers, and vendors for advancing the field and on how to benefit from tractography's use in clinical practice.

Author Correction: The challenge of mapping the human connectome based on diffusion tractography.

An amendment to this paper has been published and can be accessed via a link at the top of the paper.

The challenge of mapping the human connectome based on diffusion tractography.

Tractography based on non-invasive diffusion imaging is central to the study of human brain connectivity. To date, the approach has not been systematically validated in ground truth studies. Based on a simulated human brain data set with ground truth tracts, we organized an open international tractography challenge, which resulted in 96 distinct submissions from 20 research groups. Here, we report the encouraging finding that most state-of-the-art algorithms produce tractograms containing 90% of the ground truth bundles (to at least some extent). However, the same tractograms contain many more invalid than valid bundles, and half of these invalid bundles occur systematically across research groups. Taken together, our results demonstrate and confirm fundamental ambiguities inherent in tract reconstruction based on orientation information alone, which need to be considered when interpreting tractography and connectivity results. Our approach provides a novel framework for estimating reliability of tractography and encourages innovation to address its current limitations.