A novel knowledge representation framework for the statistical validation of quantitative imaging biomarkers.

Quantitative imaging biomarkers are of particular interest in drug development for their potential to accelerate the drug development pipeline. The lack of consensus methods and carefully characterized performance hampers the widespread availability of these quantitative measures. A framework to support collaborative work on quantitative imaging biomarkers would entail advanced statistical techniques, the development of controlled vocabularies, and a service-oriented architecture for processing large image archives. Until now, this framework has not been developed. With the availability of tools for automatic ontology-based annotation of datasets, coupled with image archives, and a means for batch selection and processing of image and clinical data, imaging will go through a similar increase in capability analogous to what advanced genetic profiling techniques have brought to molecular biology. We report on our current progress on developing an informatics infrastructure to store, query, and retrieve imaging biomarker data across a wide range of resources in a semantically meaningful way that facilitates the collaborative development and validation of potential imaging biomarkers by many stakeholders. Specifically, we describe the semantic components of our system, QI-Bench, that are used to specify and support experimental activities for statistical validation in quantitative imaging.

Inter-Method Performance Study of Tumor Volumetry Assessment on Computed Tomography Test-Retest Data.

RATIONALE AND OBJECTIVES: Tumor volume change has potential as a biomarker for diagnosis, therapy planning, and treatment response. Precision was evaluated and compared among semiautomated lung tumor volume measurement algorithms from clinical thoracic computed tomography data sets. The results inform approaches and testing requirements for establishing conformance with the Quantitative Imaging Biomarker Alliance (QIBA) Computed Tomography Volumetry Profile. MATERIALS AND METHODS: Industry and academic groups participated in a challenge study. Intra-algorithm repeatability and inter-algorithm reproducibility were estimated. Relative magnitudes of various sources of variability were estimated using a linear mixed effects model. Segmentation boundaries were compared to provide a basis on which to optimize algorithm performance for developers. RESULTS: Intra-algorithm repeatability ranged from 13% (best performing) to 100% (least performing), with most algorithms demonstrating improved repeatability as the tumor size increased. Inter-algorithm reproducibility was determined in three partitions and was found to be 58% for the four best performing groups, 70% for the set of groups meeting repeatability requirements, and 84% when all groups but the least performer were included. The best performing partition performed markedly better on tumors with equivalent diameters greater than 40 mm. Larger tumors benefitted by human editing but smaller tumors did not. One-fifth to one-half of the total variability came from sources independent of the algorithms. Segmentation boundaries differed substantially, not ony in overall volume but also in detail. CONCLUSIONS: Nine of the 12 participating algorithms pass precision requirements similar to what is indicated in the QIBA Profile, with the caveat that the present study was not designed to explicitly evaluate algorithm profile conformance. Change in tumor volume can be measured with confidence to within ±14% using any of these nine algorithms on tumor sizes greater than 10 mm. No partition of the algorithms was able to meet the QIBA requirements for interchangeability down to 10 mm, although the partition comprising best performing algorithms did meet this requirement for a tumor size of greater than approximately 40 mm.

Spatio-temporal texture (SpTeT) for distinguishing vulnerable from stable atherosclerotic plaque on dynamic contrast enhancement (DCE) MRI in a rabbit model.

PURPOSE: To develop a new spatio-temporal texture (SpTeT) based method for distinguishing vulnerable versus stable atherosclerotic plaques on DCE-MRI using a rabbit model of atherothrombosis. METHODS: Aortic atherosclerosis was induced in 20 New Zealand White rabbits by cholesterol diet and endothelial denudation. MRI was performed before (pretrigger) and after (posttrigger) inducing plaque disruption with Russell's-viper-venom and histamine. Of the 30 vascular targets (segments) under histology analysis, 16 contained thrombus (vulnerable) and 14 did not (stable). A total of 352 voxel-wise computerized SpTeT features, including 192 Gabor, 36 Kirsch, 12 Sobel, 52 Haralick, and 60 first-order textural features, were extracted on DCE-MRI to capture subtle texture changes in the plaques over the course of contrast uptake. Different combinations of SpTeT feature sets, in which the features were ranked by a minimum-redundancy-maximum-relevance feature selection technique, were evaluated via a random forest classifier. A 500 iterative 2-fold cross validation was performed for discriminating the vulnerable atherosclerotic plaque and stable atherosclerotic plaque on per voxel basis. Four quantitative metrics were utilized to measure the classification results in separating between vulnerable and stable plaques. RESULTS: The quantitative results show that the combination of five classes of SpTeT features can distinguish between vulnerable (disrupted plaques with an overlying thrombus) and stable plaques with the best AUC values of 0.9631 ± 0.0088, accuracy of 89.98% ± 0.57%, sensitivity of 83.71% ± 1.71%, and specificity of 94.55% ± 0.48%. CONCLUSIONS: Vulnerable and stable plaque can be distinguished by SpTeT based features. The SpTeT features, following validation on larger datasets, could be established as effective and reliable imaging biomarkers for noninvasively assessing atherosclerotic risk.