Artificial intelligence and radiologists in prostate cancer detection on MRI (PI-CAI): an international, paired, non-inferiority, confirmatory study.

BACKGROUND: Artificial intelligence (AI) systems can potentially aid the diagnostic pathway of prostate cancer by alleviating the increasing workload, preventing overdiagnosis, and reducing the dependence on experienced radiologists. We aimed to investigate the performance of AI systems at detecting clinically significant prostate cancer on MRI in comparison with radiologists using the Prostate Imaging-Reporting and Data System version 2.1 (PI-RADS 2.1) and the standard of care in multidisciplinary routine practice at scale. METHODS: In this international, paired, non-inferiority, confirmatory study, we trained and externally validated an AI system (developed within an international consortium) for detecting Gleason grade group 2 or greater cancers using a retrospective cohort of 10 207 MRI examinations from 9129 patients. Of these examinations, 9207 cases from three centres (11 sites) based in the Netherlands were used for training and tuning, and 1000 cases from four centres (12 sites) based in the Netherlands and Norway were used for testing. In parallel, we facilitated a multireader, multicase observer study with 62 radiologists (45 centres in 20 countries; median 7 [IQR 5-10] years of experience in reading prostate MRI) using PI-RADS (2.1) on 400 paired MRI examinations from the testing cohort. Primary endpoints were the sensitivity, specificity, and the area under the receiver operating characteristic curve (AUROC) of the AI system in comparison with that of all readers using PI-RADS (2.1) and in comparison with that of the historical radiology readings made during multidisciplinary routine practice (ie, the standard of care with the aid of patient history and peer consultation). Histopathology and at least 3 years (median 5 [IQR 4-6] years) of follow-up were used to establish the reference standard. The statistical analysis plan was prespecified with a primary hypothesis of non-inferiority (considering a margin of 0·05) and a secondary hypothesis of superiority towards the AI system, if non-inferiority was confirmed. This study was registered at ClinicalTrials.gov, NCT05489341. FINDINGS: Of the 10 207 examinations included from Jan 1, 2012, through Dec 31, 2021, 2440 cases had histologically confirmed Gleason grade group 2 or greater prostate cancer. In the subset of 400 testing cases in which the AI system was compared with the radiologists participating in the reader study, the AI system showed a statistically superior and non-inferior AUROC of 0·91 (95% CI 0·87-0·94; p<0·0001), in comparison to the pool of 62 radiologists with an AUROC of 0·86 (0·83-0·89), with a lower boundary of the two-sided 95% Wald CI for the difference in AUROC of 0·02. At the mean PI-RADS 3 or greater operating point of all readers, the AI system detected 6·8% more cases with Gleason grade group 2 or greater cancers at the same specificity (57·7%, 95% CI 51·6-63·3), or 50·4% fewer false-positive results and 20·0% fewer cases with Gleason grade group 1 cancers at the same sensitivity (89·4%, 95% CI 85·3-92·9). In all 1000 testing cases where the AI system was compared with the radiology readings made during multidisciplinary practice, non-inferiority was not confirmed, as the AI system showed lower specificity (68·9% [95% CI 65·3-72·4] vs 69·0% [65·5-72·5]) at the same sensitivity (96·1%, 94·0-98·2) as the PI-RADS 3 or greater operating point. The lower boundary of the two-sided 95% Wald CI for the difference in specificity (-0·04) was greater than the non-inferiority margin (-0·05) and a p value below the significance threshold was reached (p<0·001). INTERPRETATION: An AI system was superior to radiologists using PI-RADS (2.1), on average, at detecting clinically significant prostate cancer and comparable to the standard of care. Such a system shows the potential to be a supportive tool within a primary diagnostic setting, with several associated benefits for patients and radiologists. Prospective validation is needed to test clinical applicability of this system. FUNDING: Health~Holland and EU Horizon 2020.

Visceral adipose tissue volume effect in Crohn's disease using reduced exposure CT enterography.

PURPOSE: The purpose of this investigation was to assess the effect of visceral adipose tissue volume (VA) on reader efficacy in diagnosing and characterizing small bowel Crohn's disease using lower exposure CT enterography (CTE). Secondarily, we investigated the effect of lower exposure and VA on reader diagnostic confidence. METHODS: Prospective paired investigation of 256 CTE, 129 with Crohn's disease, were reconstructed at 100% and simulated 50% and 30% exposure. The senior author provided the disease classification for the 129 patients with Crohn's disease. Patient VA was measured, and exams were evaluated by six readers for presence or absence of Crohn's disease and phenotype using a 0-10-point scale. Logistic regression models assessed the effect of VA on sensitivity and specificity. RESULTS: The effect of VA on sensitivity was significantly reduced at 30% exposure (odds radio [OR]: 1.00) compared to 100% exposure (OR: 1.12) (p = 0.048). There was no statistically significant difference among the exposures with respect to the effect of visceral fat on specificity (p = 0.159). The study readers' probability of agreement with the senior author on disease classification was 60%, 56%, and 53% at 100%, 50%, and 30% exposure, respectively (p = 0.004). When detecting low severity Crohn's disease, readers' mean sensitivity was 83%, 75%, and 74% at 100%, 50%, and 30% exposure, respectively (p = 0.002). In low severity disease, sensitivity also tended to increase as visceral fat increased (ORs per 1000 cm3 increase in visceral fat: 1.32, 1.31, and 1.18, p = 0.010, 0.016, and 0.100, at 100%, 50%, and 30% exposure). CONCLUSIONS: While the interaction is complex, VA plays a role in detecting and characterizing small bowel Crohn's disease when exposure is altered, particularly in low severity disease.

Comparing the Accuracy of Diagnostic Tests When Disease Is Characterized by an Ordinal Scale.

In diagnostic medicine, the true disease status of a patient is often represented on an ordinal scale-for example, cancer stage (0, I, II, III, or IV) or coronary artery disease severity measured using the Coronary Artery Disease Reporting and Data System (CAD-RADS) scale (none, minimal, mild, moderate, severe, or occluded). With advances in quantitation of diagnostic images and in artificial intelligence (AI), both supervised and unsupervised algorithms are being developed to help physicians correctly grade disease. Most of the diagnostic accuracy literature deals with binary disease status (disease present or absent); however, tests diagnosing ordinal-scaled diseases should not be reduced to a binary status just to simplify diagnostic accuracy testing. In this paper, we propose different characterizations of ordinal-scale accuracy for different clinical use scenarios, along with methods for comparing tests. In the simplest scenario, just the proportion of correct grades is considered; other scenarios address the magnitude and direction of misgrading; and at the other extreme, a weighted accuracy measure with weights based on the relative costs of different types of misgrading is presented. The various scenarios are illustrated using a coronary artery disease example where the accuracy of AI algorithms in providing patients with the correct CAD-RADS grade is assessed.

Repeatability of MRI Biomarkers in Nonalcoholic Fatty Liver Disease: The NIMBLE Consortium.

Background There is a need for reliable noninvasive methods for diagnosing and monitoring nonalcoholic fatty liver disease (NAFLD). Thus, the multidisciplinary Non-invasive Biomarkers of Metabolic Liver disease (NIMBLE) consortium was formed to identify and advance the regulatory qualification of NAFLD imaging biomarkers. Purpose To determine the different-day same-scanner repeatability coefficient of liver MRI biomarkers in patients with NAFLD at risk for steatohepatitis. Materials and Methods NIMBLE 1.2 is a prospective, observational, single-center short-term cross-sectional study (October 2021 to June 2022) in adults with NAFLD across a spectrum of low, intermediate, and high likelihood of advanced fibrosis as determined according to the fibrosis based on four factors (FIB-4) index. Participants underwent up to seven MRI examinations across two visits less than or equal to 7 days apart. Standardized imaging protocols were implemented with six MRI scanners from three vendors at both 1.5 T and 3 T, with central analysis of the data performed by an independent reading center (University of California, San Diego). Trained analysts, who were blinded to clinical data, measured the MRI proton density fat fraction (PDFF), liver stiffness at MR elastography (MRE), and visceral adipose tissue (VAT) for each participant. Point estimates and CIs were calculated using χ2 distribution and statistical modeling for pooled repeatability measures. Results A total of 17 participants (mean age, 58 years ± 8.5 [SD]; 10 female) were included, of which seven (41.2%), six (35.3%), and four (23.5%) participants had a low, intermediate, or high likelihood of advanced fibrosis, respectively. The different-day same-scanner mean measurements were 13%-14% for PDFF, 6.6 L for VAT, and 3.15 kPa for two-dimensional MRE stiffness. The different-day same-scanner repeatability coefficients were 0.22 L (95% CI: 0.17, 0.29) for VAT, 0.75 kPa (95% CI: 0.6, 0.99) for MRE stiffness, 1.19% (95% CI: 0.96, 1.61) for MRI PDFF using magnitude reconstruction, 1.56% (95% CI: 1.26, 2.07) for MRI PDFF using complex reconstruction, and 19.7% (95% CI: 15.8, 26.2) for three-dimensional MRE shear modulus. Conclusion This preliminary study suggests that thresholds of 1.2%-1.6%, 0.22 L, and 0.75 kPa for MRI PDFF, VAT, and MRE, respectively, should be used to discern measurement error from real change in patients with NAFLD. ClinicalTrials.gov registration no. NCT05081427 © RSNA, 2023 Supplemental material is available for this article. See also the editorial by Kozaka and Matsui in this issue.

18F-fluciclovine PET/CT to distinguish radiation necrosis from tumor progression for brain metastases treated with radiosurgery: results of a prospective pilot study.

PURPOSE: Distinguishing radiation necrosis from tumor progression among patients with brain metastases previously treated with stereotactic radiosurgery represents a common diagnostic challenge. We performed a prospective pilot study to determine whether PET/CT with 18F-fluciclovine, a widely available amino acid PET radiotracer, repurposed intracranially, can accurately diagnose equivocal lesions. METHODS: Adults with brain metastases previously treated with radiosurgery presenting with a follow-up tumor-protocol MRI brain equivocal for radiation necrosis versus tumor progression underwent an 18F-fluciclovine PET/CT of the brain within 30 days. The reference standard for final diagnosis consisted of clinical follow-up until multidisciplinary consensus or tissue confirmation. RESULTS: Of 16 patients imaged from 7/2019 to 11/2020, 15 subjects were evaluable with 20 lesions (radiation necrosis, n = 16; tumor progression, n = 4). Higher SUVmax statistically significantly predicted tumor progression (AUC = 0.875; p = 0.011). Lesion SUVmean (AUC = 0.875; p = 0.018), SUVpeak (AUC = 0.813; p = 0.007), and SUVpeak-to-normal-brain (AUC = 0.859; p = 0.002) also predicted tumor progression, whereas SUVmax-to-normal-brain (p = 0.1) and SUVmean-to-normal-brain (p = 0.5) did not. Qualitative visual scores were significant predictors for readers 1 (AUC = 0.750; p < 0.001) and 3 (AUC = 0.781; p = 0.045), but not for reader 2 (p = 0.3). Visual interpretations were significant predictors for reader 1 (AUC = 0.898; p = 0.012) but not for reader 2 (p = 0.3) or 3 (p = 0.2). CONCLUSIONS: In this prospective pilot study of patients with brain metastases previously treated with radiosurgery presenting with a contemporary MRI brain with a lesion equivocal for radiation necrosis versus tumor progression, 18F-fluciclovine PET/CT repurposed intracranially demonstrated encouraging diagnostic accuracy, supporting the pursuit of larger clinical trials which will be necessary to establish diagnostic criteria and performance.

Multireader Diagnostic Accuracy Imaging Studies: Fundamentals of Design and Analysis.

The design and analysis of multireader multicase (MRMC) studies are quite challenging. These studies differ from most medical studies because they need a reference standard and sampling from two populations (ie, reader and patient populations). They are quite expensive to conduct, requiring a good deal of readers' time for image interpretation. One common problem is the use of imperfect reference standards, often correlated with the test or tests being evaluated. Another common issue is oversimplification of the multidimensional MRMC data. In this study, the fundamentals of MRMC study design and analysis are reviewed. The goal is to provide investigators with a guide to the fundamentals of MRMC design and analysis, with references to more detailed discussions. In addition, readers are updated on newer areas of research, including correction for studies with multiple diagnostic accuracy end points and adjustment for location bias.

Development, validation, qualification, and dissemination of quantitative MR methods: Overview and recommendations by the ISMRM quantitative MR study group.

On behalf of the International Society for Magnetic Resonance in Medicine (ISMRM) Quantitative MR Study Group, this article provides an overview of considerations for the development, validation, qualification, and dissemination of quantitative MR (qMR) methods. This process is framed in terms of two central technical performance properties, i.e., bias and precision. Although qMR is confounded by undesired effects, methods with low bias and high precision can be iteratively developed and validated. For illustration, two distinct qMR methods are discussed throughout the manuscript: quantification of liver proton-density fat fraction, and cardiac T1 . These examples demonstrate the expansion of qMR methods from research centers toward widespread clinical dissemination. The overall goal of this article is to provide trainees, researchers, and clinicians with essential guidelines for the development and validation of qMR methods, as well as an understanding of necessary steps and potential pitfalls for the dissemination of quantitative MR in research and in the clinic.

Sex-based differences in left ventricular remodeling in patients with chronic aortic regurgitation: a multi-modality study.

BACKGROUND: Significant aortic regurgitation (AR) leads to left ventricular (LV) remodeling; however, little data exist regarding sex-based differences in LV remodeling in this setting. We sought to compare LV remodeling and AR severity, assessed by echocardiography and cardiovascular magnetic resonance (CMR), to discern sex-based differences. METHODS: Patients with ≥ moderate chronic AR by echocardiography who underwent CMR within 90 days between December 2005 and October 2015 were included. Nonlinear regression models were built to assess the effect of AR regurgitant fraction (RF) on LV remodeling. A generalized linear model and Bland Altman analyses were constructed to evaluate differences between CMR and echocardiography. Referral for surgical intervention based on symptoms and LV remodeling was evaluated. RESULTS: Of the 243 patients (48.3 ± 16.6 years, 58 (24%) female), 119 (49%) underwent surgical intervention with a primary indication of severe AR, 97 (82%) men, 22 (18%) women. Significant sex differences in LV remodeling emerged on CMR. Women demonstrated significantly smaller LV end-diastolic volume index (LVEDVI) (96.8 ml/m2 vs 125.6 ml/m2, p < 0.001), LV end-systolic volume index (LVESVI) (41.1 vs 54.5 ml/m2, p < 0.001), blunted LV dilation in the setting of increasing AR severity (LVEDVI p value < 0.001, LVESVI p value 0.011), and LV length indexed (8.32 vs 9.69 cm, p < 0.001). On Bland Altman analysis, a significant interaction with sex and LV diameters was evident, demonstrating a significant increase in the difference between CMR and echocardiography measurements as the LV enlarged in women: LVEDVI (p = 0.006), LVESVI (p < 0.001), such that echocardiographic measurements increasingly underestimated LV diameters in women as the LV enlarged. LV length was higher for males with a linear effect from RF (p < 0.001), with LV length increasing at a higher rate with increasing RF for males compared to females (two-way interaction with sex p = 0.005). Sphericity volume index was higher for men after adjusting for a relative wall thickness (p = 0.033). CONCLUSIONS: CMR assessment of chronic AR revealed significant sex differences in LV remodeling and significant echocardiographic underestimation of LV dilation, particularly in women. Defining optimal sex-based CMR thresholds for surgical referral should be further developed. TRIAL REGISTRATION: NA.

The QIBA Profile for MRI-based Compositional Imaging of Knee Cartilage.

MRI-based cartilage compositional analysis shows biochemical and microstructural changes at early stages of osteoarthritis before changes become visible with structural MRI sequences and arthroscopy. This could help with early diagnosis, risk assessment, and treatment monitoring of osteoarthritis. Spin-lattice relaxation time constant in rotating frame (T1ρ) and T2 mapping are the MRI techniques best established for assessing cartilage composition. Only T2 mapping is currently commercially available, which is sensitive to water, collagen content, and orientation of collagen fibers, whereas T1ρ is more sensitive to proteoglycan content. Clinical application of cartilage compositional imaging is limited by high variability and suboptimal reproducibility of the biomarkers, which was the motivation for creating the Quantitative Imaging Biomarkers Alliance (QIBA) Profile for cartilage compositional imaging by the Musculoskeletal Biomarkers Committee of the QIBA. The profile aims at providing recommendations to improve reproducibility and to standardize cartilage compositional imaging. The QIBA Profile provides two complementary claims (summary statements of the technical performance of the quantitative imaging biomarkers that are being profiled) regarding the reproducibility of biomarkers. First, cartilage T1ρ and T2 values are measurable at 3.0-T MRI with a within-subject coefficient of variation of 4%-5%. Second, a measured increase or decrease in T1ρ and T2 of 14% or more indicates a minimum detectable change with 95% confidence. If only an increase in T1ρ and T2 values is expected (progressive cartilage degeneration), then an increase of 12% represents a minimum detectable change over time. The QIBA Profile provides recommendations for clinical researchers, clinicians, and industry scientists pertaining to image data acquisition, analysis, and interpretation and assessment procedures for T1ρ and T2 cartilage imaging and test-retest conformance. This special report aims to provide the rationale for the proposed claims, explain the content of the QIBA Profile, and highlight the future needs and developments for MRI-based cartilage compositional imaging for risk prediction, early diagnosis, and treatment monitoring of osteoarthritis.

Linearity and Bias of Proton Density Fat Fraction as a Quantitative Imaging Biomarker: A Multicenter, Multiplatform, Multivendor Phantom Study.

Background Proton density fat fraction (PDFF) estimated by using chemical shift-encoded (CSE) MRI is an accepted imaging biomarker of hepatic steatosis. This work aims to promote standardized use of CSE MRI to estimate PDFF. Purpose To assess the accuracy of CSE MRI methods for estimating PDFF by determining the linearity and range of bias observed in a phantom. Materials and Methods In this prospective study, a commercial phantom with 12 vials of known PDFF values were shipped across nine U.S. centers. The phantom underwent 160 independent MRI examinations on 27 1.5-T and 3.0-T systems from three vendors. Two three-dimensional CSE MRI protocols with minimal T1 bias were included: vendor and standardized. Each vendor's confounder-corrected complex or hybrid magnitude-complex based reconstruction algorithm was used to generate PDFF maps in both protocols. The Siemens reconstruction required a configuration change to correct for water-fat swaps in the phantom. The MRI PDFF values were compared with the known PDFF values by using linear regression with mixed-effects modeling. The 95% CIs were calculated for the regression slope (ie, proportional bias) and intercept (ie, constant bias) and compared with the null hypothesis (slope = 1, intercept = 0). Results Pooled regression slope for estimated PDFF values versus phantom-derived reference PDFF values was 0.97 (95% CI: 0.96, 0.98) in the biologically relevant 0%-47.5% PDFF range. The corresponding pooled intercept was -0.27% (95% CI: -0.50%, -0.05%). Across vendors, slope ranges were 0.86-1.02 (vendor protocols) and 0.97-1.0 (standardized protocol) at 1.5 T and 0.91-1.01 (vendor protocols) and 0.87-1.01 (standardized protocol) at 3.0 T. The intercept ranges (absolute PDFF percentage) were -0.65% to 0.18% (vendor protocols) and -0.69% to -0.17% (standardized protocol) at 1.5 T and -0.48% to 0.10% (vendor protocols) and -0.78% to -0.21% (standardized protocol) at 3.0 T. Conclusion Proton density fat fraction estimation derived from three-dimensional chemical shift-encoded MRI in a commercial phantom was accurate across vendors, imaging centers, and field strengths, with use of the vendors' product acquisition and reconstruction software. © RSNA, 2021 See also the editorial by Dyke in this issue.

Long-term inter-platform reproducibility, bias, and linearity of commercial PDFF MRI methods for fat quantification: a multi-center, multi-vendor phantom study.

OBJECTIVES: Proton density fat fraction (PDFF) is a validated biomarker of tissue fat quantification. However, validation has been limited to single-center or multi-center series using non-FDA-approved software. Thus, we assess the bias, linearity, and long-term reproducibility of PDFF obtained using commercial PDFF packages from several vendors. METHODS: Over 35 months, 438 subjects and 16 volunteers from a multi-center observational trial underwent PDFF MRI measurements using a 3-T MR system from one of three different vendors or a 1.5-T system from one vendor. Fat-water phantom sets were measured as part of each subject's examination. Manual region-of-interest measurements on the %fat image, then cross-sectional bias, linearity, and long-term reproducibility were assessed. RESULTS: Three hundred ninety-two phantom measurements were evaluable (90%). Bias ranged from 2.4 to - 3.8% for the lowest to the highest weight %fat. Regression fits of PDFF against synthesis weight %fat showed negligible non-linear effects and a linear slope of 0.94 (95% confidence interval: 0.938, 0.947). We observed significant vendor (p < 0.001) and field strength (p < 0.001) differences in bias and longitudinal variability. When the results were pooled across sites, vendors, and field strengths, the estimated reproducibility coefficient was 6.93% (95% CI: 6.25%, 7.81%). CONCLUSIONS: This study demonstrated good linearity, accuracy, and reproducibility for all investigated manufacturers and field strengths. However, significant vendor-dependent and field strength-dependent bias were found. While longitudinal PDFF measurements may be made using different field strength or vendor MR systems, if the MR system is not the same, based on these results, only PDFF changes ≥ 7% can be considered a true difference. KEY POINTS: • Phantom fat fraction (PDFF) MRI measurements over 35 months demonstrated good linearity, accuracy, and reproducibility for the vendor systems investigated. • Non-linear effects were negligible (linear slope of 0.94) over 0-100% fat; however, significant vendor (p < 0.001) and field strength (p<0.001) differences in bias and longitudinal variability were identified. Bias ranged from 2.4 to - 3.8% for 0-100 weight% fat, respectively. • Measurement bias could affect the accuracy of PDFF in clinical use. As the reproducibility coefficient was 6.93%, only greater changes in % fat can be considered true differences when making longitudinal PDFF measurements on different MR systems.

Incorporating radiomics into clinical trials: expert consensus endorsed by the European Society of Radiology on considerations for data-driven compared to biologically driven quantitative biomarkers.

Existing quantitative imaging biomarkers (QIBs) are associated with known biological tissue characteristics and follow a well-understood path of technical, biological and clinical validation before incorporation into clinical trials. In radiomics, novel data-driven processes extract numerous visually imperceptible statistical features from the imaging data with no a priori assumptions on their correlation with biological processes. The selection of relevant features (radiomic signature) and incorporation into clinical trials therefore requires additional considerations to ensure meaningful imaging endpoints. Also, the number of radiomic features tested means that power calculations would result in sample sizes impossible to achieve within clinical trials. This article examines how the process of standardising and validating data-driven imaging biomarkers differs from those based on biological associations. Radiomic signatures are best developed initially on datasets that represent diversity of acquisition protocols as well as diversity of disease and of normal findings, rather than within clinical trials with standardised and optimised protocols as this would risk the selection of radiomic features being linked to the imaging process rather than the pathology. Normalisation through discretisation and feature harmonisation are essential pre-processing steps. Biological correlation may be performed after the technical and clinical validity of a radiomic signature is established, but is not mandatory. Feature selection may be part of discovery within a radiomics-specific trial or represent exploratory endpoints within an established trial; a previously validated radiomic signature may even be used as a primary/secondary endpoint, particularly if associations are demonstrated with specific biological processes and pathways being targeted within clinical trials. KEY POINTS: • Data-driven processes like radiomics risk false discoveries due to high-dimensionality of the dataset compared to sample size, making adequate diversity of the data, cross-validation and external validation essential to mitigate the risks of spurious associations and overfitting. • Use of radiomic signatures within clinical trials requires multistep standardisation of image acquisition, image analysis and data mining processes. • Biological correlation may be established after clinical validation but is not mandatory.

Importance of incorporating quantitative imaging biomarker technical performance characteristics when estimating treatment effects.

BACKGROUND/AIMS: Quantitative imaging biomarkers have the potential to detect change in disease early and noninvasively, providing information about the diagnosis and prognosis of a patient, aiding in monitoring disease, and informing when therapy is effective. In clinical trials testing new therapies, there has been a tendency to ignore the variability and bias in quantitative imaging biomarker measurements. Unfortunately, this can lead to underpowered studies and incorrect estimates of the treatment effect. We illustrate the problem when non-constant measurement bias is ignored and show how treatment effect estimates can be corrected. METHODS: Monte Carlo simulation was used to assess the coverage of 95% confidence intervals for the treatment effect when non-constant bias is ignored versus when the bias is corrected for. Three examples are presented to illustrate the methods: doubling times of lung nodules, rates of change in brain atrophy in progressive multiple sclerosis clinical trials, and changes in proton-density fat fraction in trials for patients with nonalcoholic fatty liver disease. RESULTS: Incorrectly assuming that the measurement bias is constant leads to 95% confidence intervals for the treatment effect with reduced coverage (<95%); the coverage is especially reduced when the quantitative imaging biomarker measurements have good precision and/or there is a large treatment effect. Estimates of the measurement bias from technical performance validation studies can be used to correct the confidence intervals for the treatment effect. CONCLUSION: Technical performance validation studies of quantitative imaging biomarkers are needed to supplement clinical trial data to provide unbiased estimates of the treatment effect.

Radiological Society of North America/Quantitative Imaging Biomarker Alliance Shear Wave Speed Bias Quantification in Elastic and Viscoelastic Phantoms.

OBJECTIVES: To quantify the bias of shear wave speed (SWS) measurements between different commercial ultrasonic shear elasticity systems and a magnetic resonance elastography (MRE) system in elastic and viscoelastic phantoms. METHODS: Two elastic phantoms, representing healthy through fibrotic liver, were measured with 5 different ultrasound platforms, and 3 viscoelastic phantoms, representing healthy through fibrotic liver tissue, were measured with 12 different ultrasound platforms. Measurements were performed with different systems at different sites, at 3 focal depths, and with different appraisers. The SWS bias across the systems was quantified as a function of the system, site, focal depth, and appraiser. A single MRE research system was also used to characterize these phantoms using discrete frequencies from 60 to 500 Hz. RESULTS: The SWS from different systems had mean difference 95% confidence intervals of ±0.145 m/s (±9.6%) across both elastic phantoms and ± 0.340 m/s (±15.3%) across the viscoelastic phantoms. The focal depth and appraiser were less significant sources of SWS variability than the system and site. Magnetic resonance elastography best matched the ultrasonic SWS in the viscoelastic phantoms using a 140 Hz source but had a - 0.27 ± 0.027-m/s (-12.2% ± 1.2%) bias when using the clinically implemented 60-Hz vibration source. CONCLUSIONS: Shear wave speed reconstruction across different manufacturer systems is more consistent in elastic than viscoelastic phantoms, with a mean difference bias of < ±10% in all cases. Magnetic resonance elastographic measurements in the elastic and viscoelastic phantoms best match the ultrasound systems with a 140-Hz excitation but have a significant negative bias operating at 60 Hz. This study establishes a foundation for meaningful comparison of SWS measurements made with different platforms.

Dual-energy CT arthrography: a feasibility study.

OBJECTIVE: To evaluate the feasibility of producing 2-dimensional (2D) virtual noncontrast images and 3-dimensional (3D) bone models from dual-energy computed tomography (DECT) arthrograms and to determine whether this is best accomplished using 190 keV virtual monoenergetic images (VMI) or virtual unenhanced (VUE) images. MATERIALS AND METHODS: VMI and VUE images were retrospectively reconstructed from patients with internal derangement of the shoulder or knee joint who underwent DECT arthrography between September 2017 and August 2019. A region of interest was placed in the area of brightest contrast, and the mean attenuation (in Hounsfield units [HUs]) was recorded. Two blinded musculoskeletal radiologists qualitatively graded the 2D images and 3D models using scores ranging from 0 to 3 (0 considered optimal). RESULTS: Twenty-six patients (mean age ± SD, 57.5 ± 16.8 years; 6 women) were included in the study. The contrast attenuation on VUE images (overall mean ± SD, 10.5 ± 16.4 HU; knee, 19.3 ± 10.7 HU; shoulder, 5.0 ± 17.2 HU) was significantly lower (p < 0.001 for all comparisons) than on VMI (overall mean ± SD, 107.7 ± 43.8 HU; knee, 104.6 ± 31.1 HU; shoulder, 109.6 ± 51.0 HU). The proportion of cases with optimal scores (0 or 1) was significantly higher with VUE than with VMI for both 2D and 3D images (p < 0.001). CONCLUSIONS: DECT arthrography can be used to produce 2D virtual noncontrast images and to generate 3D bone models. The VUE technique is superior to VMI in producing virtual noncontrast images.

Low-dose CT with metal artifact reduction in arthroplasty imaging: a cadaveric and clinical study.

OBJECTIVE: To determine whether a simulated low-dose metal artifact reduction (MAR) CT technique is comparable with a clinical dose MAR technique for shoulder arthroplasty evaluation. MATERIALS AND METHODS: Two shoulder arthroplasties in cadavers and 25 shoulder arthroplasties in patients were scanned using a clinical dose (140 kVp, 300 qrmAs); cadavers were also scanned at half dose (140 kVp, 150 qrmAs). Images were reconstructed using a MAR CT algorithm at full dose and a noise-insertion algorithm simulating 50% dose reduction. For the actual and simulated half-dose cadaver scans, differences in SD for regions of interest were assessed, and streak artifact near the arthroplasty was graded by 3 blinded readers. Simulated half-dose scans were compared with full-dose scans in patients by measuring differences in implant position and by comparing readers' grades of periprosthetic osteolysis and muscle atrophy. RESULTS: The mean difference in SD between actual and simulated half-dose methods was 2.42 HU (95% CI [1.4, 3.4]). No differences in streak artifact grades were seen in 13/18 (72.2%) comparisons in cadavers. In patients, differences in implant position measurements were within 1° or 1 mm in 149/150 (99.3%) measurements. The inter-reader agreement rates were nearly identical when readers were using full-dose (77.3% [232/300] for osteolysis and 76.9% [173/225] for muscle atrophy) and simulated half-dose (76.7% [920/1200] for osteolysis and 74.0% [666/900] for muscle atrophy) scans. CONCLUSION: A simulated half-dose MAR CT technique is comparable both quantitatively and qualitatively with a standard-dose technique for shoulder arthroplasty evaluation, demonstrating that this technique could be used to reduce dose in arthroplasty imaging.

The QIBA Profile for FDG PET/CT as an Imaging Biomarker Measuring Response to Cancer Therapy.

The Quantitative Imaging Biomarkers Alliance (QIBA) Profile for fluorodeoxyglucose (FDG) PET/CT imaging was created by QIBA to both characterize and reduce the variability of standardized uptake values (SUVs). The Profile provides two complementary claims on the precision of SUV measurements. First, tumor glycolytic activity as reflected by the maximum SUV (SUVmax) is measurable from FDG PET/CT with a within-subject coefficient of variation of 10%-12%. Second, a measured increase in SUVmax of 39% or more, or a decrease of 28% or more, indicates that a true change has occurred with 95% confidence. Two applicable use cases are clinical trials and following individual patients in clinical practice. Other components of the Profile address the protocols and conformance standards considered necessary to achieve the performance claim. The Profile is intended for use by a broad audience; applications can range from discovery science through clinical trials to clinical practice. The goal of this report is to provide a rationale and overview of the FDG PET/CT Profile claims as well as its context, and to outline future needs and potential developments.

Three-dimensional US for Quantification of Volumetric Blood Flow: Multisite Multisystem Results from within the Quantitative Imaging Biomarkers Alliance.

Background Quantitative blood flow (QBF) measurements that use pulsed-wave US rely on difficult-to-meet conditions. Imaging biomarkers need to be quantitative and user and machine independent. Surrogate markers (eg, resistive index) fail to quantify actual volumetric flow. Standardization is possible, but relies on collaboration between users, manufacturers, and the U.S. Food and Drug Administration. Purpose To evaluate a Quantitative Imaging Biomarkers Alliance-supported, user- and machine-independent US method for quantitatively measuring QBF. Materials and Methods In this prospective study (March 2017 to March 2019), three different clinical US scanners were used to benchmark QBF in a calibrated flow phantom at three different laboratories each. Testing conditions involved changes in flow rate (1-12 mL/sec), imaging depth (2.5-7 cm), color flow gain (0%-100%), and flow past a stenosis. Each condition was performed under constant and pulsatile flow at 60 beats per minute, thus yielding eight distinct testing conditions. QBF was computed from three-dimensional color flow velocity, power, and scan geometry by using Gauss theorem. Statistical analysis was performed between systems and between laboratories. Systems and laboratories were anonymized when reporting results. Results For systems 1, 2, and 3, flow rate for constant and pulsatile flow was measured, respectively, with biases of 3.5% and 24.9%, 3.0% and 2.1%, and -22.1% and -10.9%. Coefficients of variation were 6.9% and 7.7%, 3.3% and 8.2%, and 9.6% and 17.3%, respectively. For changes in imaging depth, biases were 3.7% and 27.2%, -2.0% and -0.9%, and -22.8% and -5.9%, respectively. Respective coefficients of variation were 10.0% and 9.2%, 4.6% and 6.9%, and 10.1% and 11.6%. For changes in color flow gain, biases after filling the lumen with color pixels were 6.3% and 18.5%, 8.5% and 9.0%, and 16.6% and 6.2%, respectively. Respective coefficients of variation were 10.8% and 4.3%, 7.3% and 6.7%, and 6.7% and 5.3%. Poststenotic flow biases were 1.8% and 31.2%, 5.7% and -3.1%, and -18.3% and -18.2%, respectively. Conclusion Interlaboratory bias and variation of US-derived quantitative blood flow indicated its potential to become a clinical biomarker for the blood supply to end organs. © RSNA, 2020 Online supplemental material is available for this article. See also the editorial by Forsberg in this issue.

Combined Dual-Energy and Single-Energy Metal Artifact Reduction Techniques Versus Single-Energy Techniques Alone for Lesion Detection Near an Arthroplasty.

OBJECTIVE. The purpose of this study was to compare a combined dual-energy CT (DECT) and single-energy CT (SECT) metal artifact reduction technique with a SECT metal artifact reduction technique for detecting lesions near an arthroplasty in a phantom model. MATERIALS AND METHODS. Two CT phantoms with a cobalt chromium sphere attached to a titanium rod, simulating an arthroplasty, within a background of soft-tissue attenuation containing spherical lesions (range, 10-20 mm) around the head and stem of different attenuations from the background (range of attenuation, 10-70 HU) were scanned with a single CT scanner individually (unilateral) and together (bilateral) with the following three dose-equivalent techniques: the currently used clinical protocol (140 kVp, 300 Reference mAs); 100 kVp; and DECT (100 kVp and 150 kVp with a tin filter). Three radiologists reviewed the datasets to identify lesions. Nonparametric AUC was estimated for each reader with each technique. Multireader ANOVA was performed to compare AUCs. Multiple-variable logistic regression analysis was used to identify factors affecting sensitivity and specificity. RESULTS. Accuracy was lower (p < 0.001) for the DECT 130-keV technique than for the 100-, 70-, and 140-kVp techniques. Sensitivity was higher with unilateral arthroplasties (p = 0.037), with greater contrast differences from background (p < 0.001), and with the SECT 100-kVp technique versus other techniques (p < 0.001). The difference in specificities of modalities was not statistically significant (p = 0.148). CONCLUSION. Combining DECT and SECT techniques does not provide additional benefits for lesion detection as opposed to using SECT alone.

Comparison of Clinical and Semiquantitative Cartilage Grading Systems in Predicting Outcomes After Arthroscopic Partial Meniscectomy.

OBJECTIVE. Cartilage loss on preoperative knee MRI is a predictor of poor outcomes after arthroscopic partial meniscectomy. The purpose of this study was to compare the ability to predict outcomes after arthroscopic partial meniscectomy with a clinically used modified Outerbridge system versus a semiquantitative MRI Osteoarthritis Knee Score system for grading cartilage loss. MATERIALS AND METHODS. Patients who underwent preoperative knee MRI within 6 months of arthroscopic partial meniscectomy and who had outcomes available from the time of surgery and 1 year later were eligible for inclusion. Cases were evaluated by two radiologists and one radiology fellow with the use of both grading systems. The accuracy of each system in discriminating between surgical success and failure was estimated using the ROC curve (AUC) with 95% CIs. A Wald test was used to assess noninferiority of the clinical grading system. Interreader agreement regarding the accuracy of the grading systems in predicting outcomes was also compared. RESULTS. A total of 78 patients (38 women and 40 men; mean age, 56.6 years) were included in the study. A prediction model using clinical grading (AUC = 0.695; 95% CI, 0.566-0.824) was noninferior (p = 0.047) to a model using MRI Osteoarthritis Knee Score grading (AUC = 0.683; 95% CI, 0.539-0.827). Both MRI prediction models performed better than a model using demographic characteristics only (AUC = 0.667; 95% CI, 0.522-0.812). Inter-reader agreement with clinical grading (80.8%) was higher than that with MRI Osteoarthritis Knee Score grading (65.0%; p = 0.012). CONCLUSION. A clinically used system to grade cartilage loss on MRI is as effective as a semiquantitative system for predicting outcomes after arthroscopic partial meniscectomy, while also offering improved interreader agreement.