Test-retest of automated segmentation with different motion correction strategies: A comparison of prospective versus retrospective methods.

Test-retest of automated image segmentation algorithms (FSL FAST, FSL FIRST, and FREESURFER) are computed on magnetic resonance images from 12 unsedated children aged 9.4±2.6 years ([min,max] â€‹= â€‹[6.5 years, 13.8 years]) using different approaches to motion correction (prospective versus retrospective). The prospective technique, PROMO MPRAGE, dynamically estimates motion using specially acquired navigator images and adjusts the remaining acquisition accordingly, whereas the retrospective technique, MPnRAGE, uses a self-navigation property to retrospectively estimate and account for motion during image reconstruction. To increase the likelihood and range of motions, participants heads were not stabilized with padding during repeated scans. When motion was negligible both techniques had similar performance. When motion was not negligible, the automated image segmentation and anatomical labeling software tools showed the most consistent performance with the retrospectively corrected MPnRAGE technique (≥80% volume overlaps for 15 of 16 regions for FIRST and FREESURFER, with greater than 90% volume overlaps for 12 regions with FIRST and 11 regions with FREESURFER). Prospectively corrected MPRAGE with linear view-ordering also demonstrated lower performance than MPnRAGE without retrospective motion correction.

Low entropy map of brain oscillatory activity identifies spatially localized events: A new method for automated epilepsy focus prediction.

The spatial mapping of localized events in brain activity critically depends on the correct identification of the pattern signatures associated with those events. For instance, in the context of epilepsy research, a number of different electrophysiological patterns have been associated with epileptogenic activity. Motivated by the need to define automated seizure focus detectors, we propose a novel data-driven algorithm for the spatial identification of localized events that is based on the following rationale: the distribution of emerging oscillations during confined events across all recording sites is highly non-uniform and can be mapped using a spatial entropy function. By applying this principle to EEG recording obtained from 67 distinct seizure epochs, our method successfully identified the seizure focus on a group of ten drug-resistant temporal lobe epilepsy patients (average sensitivity: 0.94, average specificity: 0.90) together with its characteristic electrophysiological pattern signature. Cross-validation of the method outputs with postresective information revealed the consistency of our findings in long follow-up seizure-free patients. Overall, our methodology provides a reliable computational procedure that might be used as in both experimental and clinical domains to identify the neural populations undergoing an emerging functional or pathological transition.

Test-retest reliability of FreeSurfer automated hippocampal subfield segmentation within and across scanners.

The human hippocampus is vulnerable to a range of degenerative conditions and as such, accurate in vivo measurement of the hippocampus and hippocampal substructures via neuroimaging is of great interest for understanding mechanisms of disease as well as for use as a biomarker in clinical trials of novel therapeutics. Although total hippocampal volume can be measured relatively reliably, it is critical to understand how this reliability is affected by acquisition on different scanners, as multiple scanning platforms would likely be utilized in large-scale clinical trials. This is particularly true for hippocampal subregional measurements, which have only relatively recently been measurable through common image processing platforms such as FreeSurfer. Accurate segmentation of these subregions is challenging due to their small size, magnetic resonance imaging (MRI) signal loss in medial temporal regions of the brain, and lack of contrast for delineation from standard neuroimaging procedures. Here, we assess the test-retest reliability of the FreeSurfer automated hippocampal subfield segmentation procedure using two Siemens model scanners (a Siemens Trio and Prismafit Trio upgrade). T1-weighted images were acquired for 11 generally healthy younger participants (two scans on the Trio and one scan on the Prismafit). Each scan was processed through the standard cross-sectional stream and the recently released longitudinal pipeline in FreeSurfer v6.0 for hippocampal segmentation. Test-retest reliability of the volumetric measures was examined for individual subfields as well as percent volume difference and Dice overlap among scans and intra-class correlation coefficients (ICC). Reliability was high in the molecular layer, dentate gyrus, and whole hippocampus with the inclusion of three time points with mean volume differences among scans less than 3%, overlap greater than 80%, and ICC >0.95. The parasubiculum and hippocampal fissure showed the least improvement in reliability with mean volume difference greater than 5%, overlap less than 70%, and ICC scores ranging from 0.78 to 0.89. Other subregions, including the CA regions, were stable in their mean volume difference and overlap (<5% difference and >75% respectively) and showed improvement in reliability with the inclusion of three scans (ICC â€‹> â€‹0.9). Reliability was generally higher within scanner (Trio-Trio), however, Trio-Prismafit reliability was also high and did not exhibit an obvious bias. These results suggest that the FreeSurfer automated segmentation procedure is a reliable method to measure total as well as hippocampal subregional volumes and may be useful in clinical applications including as an endpoint for future clinical trials of conditions affecting the hippocampus.

Inverse transformed encoding models - a solution to the problem of correlated trial-by-trial parameter estimates in fMRI decoding.

Techniques of multivariate pattern analysis (MVPA) can be used to decode the discrete experimental condition or a continuous modulator variable from measured brain activity during a particular trial. In functional magnetic resonance imaging (fMRI), trial-wise response amplitudes are sometimes estimated from the measured signal using a general linear model (GLM) with one onset regressor for each trial. When using rapid event-related designs with trials closely spaced in time, those estimates are highly variable and serially correlated due to the temporally extended shape of the hemodynamic response function (HRF). Here, we describe inverse transformed encoding modelling (ITEM), a principled approach of accounting for those serial correlations and decoding from the resulting estimates, at low computational cost and with no loss in statistical power. We use simulated data to show that ITEM outperforms the current standard approach in terms of decoding accuracy and analyze empirical data to demonstrate that ITEM is capable of visual reconstruction from fMRI signals.

RFDCR: Automated brain lesion segmentation using cascaded random forests with dense conditional random fields.

Segmentation of brain lesions from magnetic resonance images (MRI) is an important step for disease diagnosis, surgical planning, radiotherapy and chemotherapy. However, due to noise, motion, and partial volume effects, automated segmentation of lesions from MRI is still a challenging task. In this paper, we propose a two-stage supervised learning framework for automatic brain lesion segmentation. Specifically, in the first stage, intensity-based statistical features, template-based asymmetric features, and GMM-based tissue probability maps are used to train the initial random forest classifier. Next, the dense conditional random field optimizes the probability maps from the initial random forest classifier and derives the whole tumor regions referred as the region of interest (ROI). In the second stage, the optimized probability maps are further intergraded with features from the intensity-based statistical features and template-based asymmetric features to train subsequent random forest, focusing on classifying voxels within the ROI. The output probability maps will be also optimized by the dense conditional random fields, and further used to iteratively train a cascade of random forests. Through hierarchical learning of the cascaded random forests and dense conditional random fields, the multimodal local and global appearance information is integrated with the contextual information, and the output probability maps are improved layer by layer to finally obtain optimal segmentation results. We evaluated the proposed method on the publicly available brain tumor datasets BRATS 2015 & BRATS 2018, as well as the ischemic stroke dataset ISLES 2015. The results have shown that our framework achieves competitive performance compared to the state-of-the-art brain lesion segmentation methods. In addition, contralateral difference and skewness were identified as the important features in the brain tumor and ischemic stroke segmentation tasks, which conforms to the knowledge and experience of medical experts, further reflecting the reliability and interpretability of our framework.

TbCAPs: A toolbox for co-activation pattern analysis.

Functional magnetic resonance imaging provides rich spatio-temporal data of human brain activity during task and rest. Many recent efforts have focussed on characterising dynamics of brain activity. One notable instance is co-activation pattern (CAP) analysis, a frame-wise analytical approach that disentangles the different functional brain networks interacting with a user-defined seed region. While promising applications in various clinical settings have been demonstrated, there is not yet any centralised, publicly accessible resource to facilitate the deployment of the technique. Here, we release a working version of TbCAPs, a new toolbox for CAP analysis, which includes all steps of the analytical pipeline, introduces new methodological developments that build on already existing concepts, and enables a facilitated inspection of CAPs and resulting metrics of brain dynamics. The toolbox is available on a public academic repository at https://c4science.ch/source/CAP_Toolbox.git. In addition, to illustrate the feasibility and usefulness of our pipeline, we describe an application to the study of human cognition. CAPs are constructed from resting-state fMRI using as seed the right dorsolateral prefrontal cortex, and, in a separate sample, we successfully predict a behavioural measure of continuous attentional performance from the metrics of CAP dynamics (R â€‹= â€‹0.59).

Decoding spectro-temporal representation for motor imagery recognition using ECoG-based brain-computer interfaces.

One of the challenges in brain-computer interface systems is obtaining motor imagery recognition from brain activities. Brain-signal decoding robustness and system performance improvement during the motor imagery process are two of the essential issues in brain-computer interface research. In conventional approaches, ineffective decoding of features and high complexity of algorithms often lead to unsatisfactory performance. A novel method for the recognition of motor imagery tasks is developed based on employing a modified S-transforms for spectro-temporal representation to characterize the behavior of electrocorticogram activities. A classifier is trained by using a support vector machine, and an optimized wrapper approach is applied to guide selection to implement the representation selection obtained. A channel selection algorithm optimizes the wrapper approach by adding a cross-validation step, which effectively improves the classification performance. The modified S-transform can accurately capture event-related desynchronization/event-related synchronization phenomena and can effectively locate sensorimotor rhythm information. The optimized wrapper approach used in this scheme can effectively reduce the feature dimension and improve algorithm efficiency. The method is evaluated on a public electrocorticogram dataset with a recognition accuracy of 98% and an information transfer rate of 0.8586 bit/trial. To verify the effect of the channel selection, both electrocorticogram and electroencephalogram data are experimentally analyzed. Furthermore, the computational efficiency of this scheme demonstrates its potential for online brain-computer interface systems in future cognitive tasks.

Age-related differences in task-induced brain activation is not task specific: Multivariate pattern generalization between metacognition, cognition and perception.

Adolescence is associated with widespread maturation of brain structures and functional connectivity profiles that shift from local to more distributed and better integrated networks, which are active during a variety of cognitive tasks. Nevertheless, the approach to examine task-induced developmental brain changes is function-specific, leaving the question open whether functional maturation is specific to the particular cognitive demands of the task used, or generalizes across different tasks. In the present study we examine the hypothesis that functional brain maturation is driven by global changes in how the brain handles cognitive demands. Multivariate pattern classification analysis (MVPA) was used to examine whether age discriminative task-induced activation patterns generalize across a wide range of information processing levels. 25 young (13-years old) and 22 old (17-years old) adolescents performed three conceptually different tasks of metacognition, cognition and visual processing. MVPA applied within each task indicated that task-induced brain activation is consistent and reliably different between ages 13 and 17. These age-discriminative activation patterns proved to be common across the different tasks used, despite the differences in cognitive demands and brain structures engaged by each of the three tasks. MVP classifiers trained to detect age-discriminative patterns in brain activation during one task were significantly able to decode age from brain activation maps during execution of other tasks with accuracies between 63 and 75%. The results emphasize that age-specific characteristics of task-induced brain activation have to be understood at the level of brain-wide networks that show maturational changes in their organization and processing efficacy during adolescence.

Machine learning identifies unaffected first-degree relatives with functional network patterns and cognitive impairment similar to those of schizophrenia patients.

Schizophrenia (SCZ) patients and their unaffected first-degree relatives (FDRs) share similar functional neuroanatomy. However, it remains largely unknown to what extent unaffected FDRs with functional neuroanatomy patterns similar to patients can be identified at an individual level. In this study, we used a multivariate pattern classification method to learn informative large-scale functional networks (FNs) and build classifiers to distinguish 32 patients from 30 healthy controls and to classify 34 FDRs as with or without FNs similar to patients. Four informative FNs-the cerebellum, default mode network (DMN), ventral frontotemporal network, and posterior DMN with parahippocampal gyrus-were identified based on a training cohort and pattern classifiers built upon these FNs achieved a correct classification rate of 83.9% (sensitivity 87.5%, specificity 80.0%, and area under the receiver operating characteristic curve [AUC] 0.914) estimated based on leave-one-out cross-validation for the training cohort and a correct classification rate of 77.5% (sensitivity 72.5%, specificity 82.5%, and AUC 0.811) for an independent validation cohort. The classification scores of the FDRs and patients were negatively correlated with their measures of cognitive function. FDRs identified by the classifiers as having SCZ patterns were similar to the patients, but significantly different from the controls and FDRs with normal patterns in terms of their cognitive measures. These results demonstrate that the pattern classifiers built upon the informative FNs can serve as biomarkers for quantifying brain alterations in SCZ and help to identify FDRs with FN patterns and cognitive impairment similar to those of SCZ patients.

Antinuclear antibodies detection: A comparative study between automated recognition and conventional visual interpretation.

BACKGROUND: The indirect immunofluorescence assay (IIFA) for the detection of antinuclear antibodies (ANA) was firstly described in 1958 and is still considered the reference method for ANA screening. Currently, an automated processing and recognition system for standardized and efficient ANA interpretation by human epithelial (HEp-2) cell-based immunofluorescence (IIF; EUROPattern Suite, Euroimmun) is available in China. METHODS: In this study, the performance of this novel system for positive/negative classification, pattern recognition (including homogenous, speckled, nucleolar, nuclear dots, cytoplasmic, and centromeres patterns) and titers evaluation was evaluated by comparing to visual interpretation. RESULTS: Referring to the total of 3681 collected samples, there was an agreement of 98.7% (κ = 0.973) between the visual and automated examination regarding positive/negative discrimination. In sera with single pattern, correct pattern recognition was observed in 94.6% of the samples. The efficiency of automated recognition for single pattern varied for the different patterns. The automatically determined patterns were correct and complete in 1071 of 1620 cases and correct and meaningful but not complete ("main pattern") in another 405 cases, enabling main pattern recognition in 91.1% of all cases. Referring to the titers evaluation, the results within the next titer were considered to be consistent. In 1603 positive sera both by visual and automated evaluation, titers of 1514 sample were consistent, accounting for 94.4%. CONCLUSION: Attributed to the performance characteristics, EUROPattern system is suitable for clinical use as its high degree of automation and result reliability, and may help clinical laboratories to standardize of IIF evaluation.

Automatic Multi-Camera Extrinsic Parameter Calibration Based on Pedestrian Torsors.

Extrinsic camera calibration is essential for any computer vision task in a camera network. Typically, researchers place a calibration object in the scene to calibrate all the cameras in a camera network. However, when installing cameras in the field, this approach can be costly and impractical, especially when recalibration is needed. This paper proposes a novel, accurate and fully automatic extrinsic calibration framework for camera networks with partially overlapping views. The proposed method considers the pedestrians in the observed scene as the calibration objects and analyzes the pedestrian tracks to obtain extrinsic parameters. Compared to the state of the art, the new method is fully automatic and robust in various environments. Our method detect human poses in the camera images and then models walking persons as vertical sticks. We apply a brute-force method to determines the correspondence between persons in multiple camera images. This information along with 3D estimated locations of the top and the bottom of the pedestrians are then used to compute the extrinsic calibration matrices. We also propose a novel method to calibrate the camera network by only using the top and centerline of the person when the bottom of the person is not available in heavily occluded scenes. We verified the robustness of the method in different camera setups and for both single and multiple walking people. The results show that the triangulation error of a few centimeters can be obtained. Typically, it requires less than one minute of observing the walking people to reach this accuracy in controlled environments. It also just takes a few minutes to collect enough data for the calibration in uncontrolled environments. Our proposed method can perform well in various situations such as multi-person, occlusions, or even at real intersections on the street.

Reproducibility of importance extraction methods in neural network based fMRI classification.

Recent advances in machine learning allow faster training, improved performance and increased interpretability of classification techniques. Consequently, their application in neuroscience is rapidly increasing. While classification approaches have proved useful in functional magnetic resonance imaging (fMRI) studies, there are concerns regarding extraction, reproducibility and visualization of brain regions that contribute most significantly to the classification. We addressed these issues using an fMRI classification scheme based on neural networks and compared a set of methods for extraction of category-related voxel importances in three simulated and two empirical datasets. The simulation data revealed that the proposed scheme successfully detects spatially distributed and overlapping activation patterns upon successful classification. Application of the proposed classification scheme to two previously published empirical fMRI datasets revealed robust importance maps that extensively overlap with univariate maps but also provide complementary information. Our results demonstrate increased statistical power of importance maps compared to univariate approaches for both detection of overlapping patterns and patterns with weak univariate information.

Prospective motion correction improves the sensitivity of fMRI pattern decoding.

We evaluated the effectiveness of prospective motion correction (PMC) on a simple visual task when no deliberate subject motion was present. The PMC system utilizes an in-bore optical camera to track an external marker attached to the participant via a custom-molded mouthpiece. The study was conducted at two resolutions (1.5 mm vs 3 mm) and under three conditions (PMC On and Mouthpiece On vs PMC Off and Mouthpiece On vs PMC Off and Mouthpiece Off). Multiple data analysis methods were conducted, including univariate and multivariate approaches, and we demonstrated that the benefit of PMC is most apparent for multi-voxel pattern decoding at higher resolutions. Additional testing on two participants showed that our inexpensive, commercially available mouthpiece solution produced comparable results to a dentist-molded mouthpiece. Our results showed that PMC is increasingly important at higher resolutions for analyses that require accurate voxel registration across time.

Ultrasound registration: A review.

This article is a review of registration algorithms for use between ultrasound images (monomodal image-based ultrasound registration). Ultrasound is safe, inexpensive, and real-time, providing many advantages for clinical and scientific use on both humans and animals, but ultrasound images are also notoriously noisy and subject to several unique artifacts/distortions. This paper introduces the topic and unique aspects of ultrasound-to-ultrasound image registration, providing a broad introduction and summary of the literature and the field. Both theoretical and practical aspects are introduced. The first half of the paper is theoretical, organized according to the basic components of a registration framework, namely preprocessing, image-similarity metrics, optimizers, etc. It further subdivides these methods between those suitable for elastic (non-rigid) vs. inelastic (matrix) transforms. The second half of the paper is organized by anatomy and is practical in nature, presenting and discussing the complete published systems that have been validated for registration in specific anatomic regions.

Graphical aids for visualizing and interpreting patterns in departures from agreement in ordinal categorical observer agreement data.

When studying the agreement between two observers rating the same n units into the same k discrete ordinal categories, Bangdiwala (1985) proposed using the "agreement chart" to visually assess agreement. This article proposes that often it is more interesting to focus on the patterns of disagreement and visually understanding the departures from perfect agreement. The article reviews the use of graphical techniques for descriptively assessing agreement and disagreements, and also reviews some of the available summary statistics that quantify such relationships.

Reference standard space hippocampus labels according to the European Alzheimer's Disease Consortium-Alzheimer's Disease Neuroimaging Initiative harmonized protocol: Utility in automated volumetry.

INTRODUCTION: A harmonized protocol (HarP) for manual hippocampal segmentation on magnetic resonance imaging (MRI) has recently been developed by an international European Alzheimer's Disease Consortium-Alzheimer's Disease Neuroimaging Initiative project. We aimed at providing consensual certified HarP hippocampal labels in Montreal Neurological Institute (MNI) standard space to serve as reference in automated image analyses. METHODS: Manual HarP tracings on the high-resolution MNI152 standard space template of four expert certified HarP tracers were combined to obtain consensual bilateral hippocampus labels. Utility and validity of these reference labels is demonstrated in a simple atlas-based morphometry approach for automated calculation of HarP-compliant hippocampal volumes within SPM software. RESULTS: Individual tracings showed very high agreement among the four expert tracers (pairwise Jaccard indices 0.82-0.87). Automatically calculated hippocampal volumes were highly correlated (rL/R = 0.89/0.91) with gold standard volumes in the HarP benchmark data set (N = 135 MRIs), with a mean volume difference of 9% (standard deviation 7%). CONCLUSION: The consensual HarP hippocampus labels in the MNI152 template can serve as a reference standard for automated image analyses involving MNI standard space normalization.

18F-FDG PET/CT heterogeneity quantification through textural features in the era of harmonisation programs: a focus on lung cancer.

PURPOSE: Quantification of tumour heterogeneity in PET images has recently gained interest, but has been shown to be dependent on image reconstruction. This study aimed to evaluate the impact of the EANM/EARL accreditation program on selected 18F-FDG heterogeneity metrics. METHODS: To carry out our study, we prospectively analysed 71 tumours in 60 biopsy-proven lung cancer patient acquisitions reconstructed with unfiltered point spread function (PSF) positron emission tomography (PET) images (optimised for diagnostic purposes), PSF-reconstructed images with a 7-mm Gaussian filter (PSF7) chosen to meet European Association of Nuclear Medicine (EANM) 1.0 harmonising standards, and EANM Research Ltd. (EARL)-compliant ordered subset expectation maximisation (OSEM) images. Delineation was performed with fuzzy locally adaptive Bayesian (FLAB) algorithm on PSF images and reported on PSF7 and OSEM ones, and with a 50 % standardised uptake values (SUV)max threshold (SUVmax50%) applied independently to each image. Robust and repeatable heterogeneity metrics including 1st-order [area under the curve of the cumulative histogram (CHAUC)], 2nd-order (entropy, correlation, and dissimilarity), and 3rd-order [high-intensity larger area emphasis (HILAE) and zone percentage (ZP)] textural features (TF) were statistically compared. RESULTS: Volumes obtained with SUVmax50% were significantly smaller than FLAB-derived ones, and were significantly smaller in PSF images compared to OSEM and PSF7 images. PSF-reconstructed images showed significantly higher SUVmax and SUVmean values, as well as heterogeneity for CHAUC, dissimilarity, correlation, and HILAE, and a wider range of heterogeneity values than OSEM images for most of the metrics considered, especially when analysing larger tumours. Histological subtypes had no impact on TF distribution. No significant difference was observed between any of the considered metrics (SUV or heterogeneity features) that we extracted from OSEM and PSF7 reconstructions. Furthermore, the distributions of TF for OSEM and PSF7 reconstructions according to tumour volumes were similar for all ranges of volumes. CONCLUSION: PSF reconstruction with Gaussian filtering chosen to meet harmonising standards resulted in similar SUV values and heterogeneity information as compared to OSEM images, which validates its use within the harmonisation strategy context. However, unfiltered PSF-reconstructed images also showed higher heterogeneity according to some metrics, as well as a wider range of heterogeneity values than OSEM images for most of the metrics considered, especially when analysing larger tumours. This suggests that, whenever available, unfiltered PSF images should also be exploited to obtain the most discriminative quantitative heterogeneity features.