Understanding reasons for image rejection by radiologists and radiographers.

INTRODUCTION: A core element of a radiographer's role is the decision on whether a radiograph is sufficient for diagnosis, or a repeat examination is needed. Studies illustrate the disagreement on the diagnostic value of radiographs between radiographers and radiologists, which may influence repeat examinations. This study investigates if parameters contributing to image quality are possible determinants to explain the difference between professions. METHODS: A total of 74 radiographers and radiologists from three different countries assessed three data sets (chest PA, hip HBL, c-spine lateral), each containing 25 radiographs. All observers scored image quality in terms of anatomical visualisation, positioning, collimation, detector exposure and judged the diagnostic value using the ACR RadLex classification. All assessments were performed on a clinically relevant display. Visual grading characteristics were used to compare image quality evaluations between groups. RESULTS: Radiographers scored the visualisation of anatomical structures lower than radiologists though the difference was not statistically significant. A difference in classification using the RadLex categories - with radiographers rejecting more radiographs - was demonstrated. Only the subjective evaluation of the detector exposure correlated statistically with RadLex ratings. There was no difference between radiographers and radiologists when reviewing patient positioning and collimation. CONCLUSION: Radiographers and radiologists agree on the visualisation of anatomical structures, but radiographers are more critical towards the diagnostic value. Within the criteria studied, the evaluation of anatomical structures does not explain the difference. Radiographs have a higher change of being rejected if the observer (subjectively) assessed the detector exposure as inappropriate. This correlation is stronger for radiographers.

Chondroid Tumors of Bone.

Recent scholarship on enchondroma, chondrosarcoma, and chondroblastoma is presented. The focus of this article is on the imaging appearance of these tumors and the means by which they can be distinguished from one another by both clinical and imaging criteria.

Osteoid Tumors of Bone.

We present a review of several bone (osteoid)-forming tumors including enostosis, osteoid osteoma, osteoblastoma, and osteosarcoma. These entities were chosen because they are reasonably common-neither seen every day nor rare. When applicable, recent information about the lesions is included.

Benign Osseous Tumors and Tumor-Like Conditions.

We will provide an imaging-focused discussion of 3 benign bone tumors that do not fit in the categories of cartilaginous tumors or osteoid tumors. We have chosen giant cell tumor of bone, unicameral bone cyst, and fibrous dysplasia. All 3 of these entities are common enough that one does not have to be a musculoskeletal radiologist in a cancer hospital to encounter them occasionally, but none of them should be seen frequently.

Interpretation time for screening mammography as a function of the number of computer-aided detection marks.

Purpose: Computer-aided detection (CAD) alerts radiologists to findings potentially associated with breast cancer but is notorious for creating false-positive marks. Although a previous paper found that radiologists took more time to interpret mammograms with more CAD marks, our impression was that this was not true in actual interpretation. We hypothesized that radiologists would selectively disregard these marks when present in larger numbers. Approach: We performed a retrospective review of bilateral digital screening mammograms. We use a mixed linear regression model to assess the relationship between number of CAD marks and ln (interpretation time) after adjustment for covariates. Both readers and mammograms were treated as random sampling units. Results: Ten radiologists, with median experience after residency of 12.5 years (range 6 to 24) interpreted 1832 mammograms. After accounting for number of images, Breast Imaging Reporting and Data System category, and breast density, the number of CAD marks was positively associated with longer interpretation time, with each additional CAD mark proportionally increasing median interpretation time by 4.35% for a typical reader. Conclusions: We found no support for our hypothesis that radiologists will selectively disregard CAD marks when they are present in larger numbers.

Confidence Calibration: An Introduction With Application to Quality Improvement.

A probabilistic forecast is one that assigns a probability (or likelihood) to the occurrence of an event. Radiologists commonly make probabilistic judgments in their reports, even if these predictions are not explicitly expressed as numbers. There are calls for radiologists to commit to their probabilistic predictions in a standardized fashion; however, without a mechanism for feedback, there is no opportunity for improvement. Analysis techniques familiar to radiologists (eg, calculation of sensitivity and specificity and construction of receiver operating characteristics curves) have a blind spot with regard to calibration of these probabilities to reality and are the main obstacle to improvement along this axis. We review statistical and graphical methods for calibration analysis in wider use outside the medical literature and present a framework for implementation of these techniques for quality improvement and radiologist self-assessment.

Gadolinium-based Contrast Agents Improve Detection of Recurrent Soft-Tissue Sarcoma at MRI.

Purpose: To determine the diagnostic efficacy of gadolinium-based contrast agents for the detection of recurrent soft-tissue sarcoma compared with non-contrast-enhanced conventional MRI sequences. Materials and Methods: A retrospective study of patients with soft-tissue sarcomas who were imaged from January 2009 to December 2014 was performed. MRI studies from 69 patients (mean age, 61 years ± 15 [standard deviation], 45 men) with recurrent soft-tissue sarcoma and 63 age-, sex-, and tumor-matched controls with positive findings (nonrecurrence) were presented to six musculoskeletal radiologists at a tertiary cancer center in three image groupings. Group 1 consisted of precontrast T1-weighted and fat-suppressed T2-weighted images (no contrast agent). Group 2 consisted of precontrast and postcontrast fat-saturated T1-weighted images. Group 3 consisted of precontrast and fat-saturated postcontrast T1- and fat-suppressed T2-weighted images. Images within these three groups contained either recurrent soft-tissue sarcomas or positive postoperative findings (nonsarcoma). The presentation order of the first two image sets was reversed for half the readers. The readers were asked to classify presence of tumor on a five-point scale. The average score from the readers was used as consensus score for each case, and a case was considered positive if the average score was less than 3. Receiver operating characteristic (ROC) analysis was performed using the average score for each image set. Results: Assessment of the group 3 image set resulted in higher sensitivity (74%, 95% confidence interval [CI]: 62%, 83%) than the group 2 image set (64%, 95% CI: 51%, 75%), which was also more sensitive than the assessment of the group 1 images set (49%, 95% CI: 37%, 61%), with P = .02 for both. There was no significant difference in specificity between the three groups. The area under the ROC curve (AUC) for the assessment of group 1 was 0.78 (95% CI: 0.70, 0.86), which was significantly lower than that of group 2, 0.92 (95% CI: 0.87, 0.96) and group 3, 0.93 (95% CI: 0.88, 0.97), with P values of .0006 and < .0001, respectively. There was no difference between the AUCs of groups 2 and 3 (P = .58). Conclusion: Gadolinium-based contrast agents improved diagnostic performance in detection of recurrent soft-tissue sarcoma. Addition of fat-saturated T2-weighted images provided modest improvement in sensitivity.Keywords: Efficacy Studies, MR-Contrast Agent, Oncology, Soft Tissues/Skin© RSNA, 2020.

Special Section Guest Editorial: Medical Image Perceptions and Observer Performance.

This guest editorial introduces the special section on Medical Image Perceptions and Observer Performance.

Consultation and citation rates for prior imaging studies and documents in radiology.

Frequently, the consensus conclusion after quality assurance conferences in radiology is that whatever mistake was made could have been avoided if more prior images or documents had been consulted. It is generally assumed that anything that was not specifically cited in the report had not been consulted. Is it actually safe to assume that an image or document that is not cited was also not consulted? It is this question that this investigation addresses. In this Institutional Review Board-approved study, one observer watched the board-certified radiologists while they interpreted imaging studies and issued reports. He recorded what type of study was being interpreted [either computed tomography, magnetic resonance imaging, or conventional radiography (x-ray)]. He also recorded the number and type of prior imaging studies and documents that were consulted during the interpretation. These observations were then compared with the signed report to determine how many of the consulted imaging studies and documents were cited. Of the 198 previous imaging studies that the radiologists consulted, 116 (58.6%) were cited in a report. Of the 285 documents consulted, 3 (1.1%) were cited in a report. This difference in citation rate was statistically significant ([Formula: see text]). It cannot be safely assumed that an older radiologic image or medical document was not consulted during radiologic interpretation merely because it is not cited in the report. Radiologists often consult more old studies than they cite, and they do not cite the majority of prior documents that they consult.

VIDEO: Preoperative CT Angiography for Fibular Free Flap Reconstructions.

OBJECTIVE: The objective of this video article is to provide an introduction to the use of fibular free flaps. Normal and variant vascular anatomy of the fibular free flap is discussed, as are imaging acquisition and CT angiography interpretation, computer-assisted design and manufacturing, and the limitations of the fibular free flap. CONCLUSION: The fibular free flap is commonly used for head and neck reconstructive surgery. Variation exists between individuals regarding the origin of the peroneal artery and the perforating arteries. Our method of performing CT angiography and reporting its findings for patients undergoing a fibular free flap procedure provides a reproducible means of identifying important elements of the vasculature and effectively communicating their locations to surgeons. Accurate communication can maximize the success of the flap harvesting and the preoperative manufacture of custom fibular cutting guides.

Model observer for assessing digital breast tomosynthesis for multi-lesion detection in the presence of anatomical noise.

Model observers are widely used in task-based assessments of medical image quality. The presence of multiple abnormalities in a single set of images, such as in multifocal multicentric breast cancer (MFMC), has an immense clinical impact on treatment planning and survival outcomes. Detecting multiple breast tumors is challenging as MFMC is relatively uncommon, and human observers do not know the number or locations of tumors a priori. Digital breast tomosynthesis (DBT), in which an x-ray beam sweeps over a limited angular range across the breast, has the potential to improve the detection of multiple tumors. However, prior studies of DBT image quality all focus on unifocal breast cancers. In this study, we extended our 2D multi-lesion (ML) channelized Hotelling observer (CHO) into a 3D ML-CHO that detects multiple lesions from volumetric imaging data. Then we employed the 3D ML-CHO to identify optimal DBT acquisition geometries for detection of MFMC. Digital breast phantoms with multiple embedded synthetic lesions were scanned by simulated DBT scanners of different geometries (wide/narrow angular span, different number of projections per scan) to simulate MFMC cases. With new implementations of 3D partial least squares (PLS) and modified Laguerre-Gauss (LG) channels, the 3D ML-CHO made detection decisions based upon the overall information from individual DBT slices and their correlations. Our evaluation results show that: (1) the 3D ML-CHO could achieve good detection performance with a small number of channels, and 3D PLS channels on average outperform the counterpart LG channels; (2) incorporating locally varying anatomical backgrounds and their correlations as in the 3D ML-CHO is essential for multi-lesion detection; (3) the most effective DBT geometry for detection of MFMC may vary when the task of clinical interest changes, and a given DBT geometry may not yield images that are equally informative for detecting MF, MC, and unifocal cancers.

Memory bias in observer-performance literature.

The objective of our study was to determine how authors of published observer-performance experiments dealt with memory bias in study design. We searched American Journal of Roentgenology online and Radiology using "observer study" and "observer performance." We included articles from 1970 or later that reported an observer performance experiment using human observers. We recorded the methods used by the authors to order presentation of the conditions being tested and images within sets for viewing. We recorded use and length of any time gap between viewings. We included 110 experiments. Forty-five used methods not subject to memory bias. Of 68 remaining experiments, 30 (44.1%) ordered the viewing of tested conditions to decrease memory bias. Fifteen (22.1%) ordered the tested conditions in ways that may create memory bias. Eleven (16.2%) intermixed the tested conditions. Forty-three (63.2%) used random or pseudorandom ordering of images within sets. Forty-six (67.6%) used a time gap (median 14 days) between viewings. Six (8.8%) did not use a time gap. Thirty-six (52.9%) did not indicate what methods they used in at least one studied parameter. Therefore, we conclude that 22.1% of the experiments could improve their methods of ordering tested conditions. Completeness of reporting could be improved by including more details regarding methods of ameliorating memory bias.

18F-FDG PET/CT as an Indicator of Survival in Ewing Sarcoma of Bone.

Objective: The existing literature of 18 F-FDG PET/CT in Ewing sarcoma investigates mixed populations of patients with both soft tissue and bone primary tumors. The aim of our study was to evaluate whether the maximum standardized uptake value (SUVmax) obtained with 18F-FDG PET/CT before and after induction chemotherapy can be used as an indicator of survival in patients with Ewing sarcoma originating exclusively in the skeleton. Materials and Methods: A retrospective database search from 2004-2011 identified 28 patients who underwent 18 F-FDG PET/CT before (SUV1, n= 28) and after (SUV2, n=23) induction chemotherapy. Mean follow up was 3.3 years and median follow up for survivors was 6.3 years (range: 2.6-9.8 years). Multivariate and univariate Cox proportional hazard model was used to assess for correlation of SUV1, SUV2, and the change in SUVmax with overall survival (OS) and progression-free survival (PFS). Results: Mean SUVmax was 10.74 before (SUV1) and after 4.11 (SUV2) induction chemotherapy. High SUV1 (HR = 1.05, 95% CI: 1.0-1.1, P = 0.01) and SUV2 (HR =1.2, 95% CI: 1.0-1.4, P = 0.01) were associated with worse OS. A cut off point of 11.6 was identified for SUV1. SUV1 higher than 11.6 had significantly worse OS (HR = 5.71, 95% CI: 1.85 - 17.61, P = 0.003) and PFS (HR = 3.16, 95% CI: 1.13 - 8.79, P = 0.03, P < 0.05 is significant). Conclusion: 18F-FDG PET/CT can be used as a prognostic indicator for survival in primary Ewing sarcoma of bone.

VIDEO: Preoperative CT Angiography for Anterolateral Thigh Flap Reconstructions.

OBJECTIVE: This video article will review the relevant vascular anatomy of the anterolateral thigh flap, describe the CT angiography (CTA) image acquisition, and describe how to report the locations of the perforating arteries along with characteristics that may be important to the surgeon. CONCLUSION: Our method of performing and reporting CTA for patients scheduled to undergo anterolateral thigh flap reconstruction provides a reproducible method of identifying perforating vessels and communicating their location to surgeons.

A half-second glimpse often lets radiologists identify breast cancer cases even when viewing the mammogram of the opposite breast.

Humans are very adept at extracting the "gist" of a scene in a fraction of a second. We have found that radiologists can discriminate normal from abnormal mammograms at above-chance levels after a half-second viewing (d' ∼ 1) but are at chance in localizing the abnormality. This pattern of results suggests that they are detecting a global signal of abnormality. What are the stimulus properties that might support this ability? We investigated the nature of the gist signal in four experiments by asking radiologists to make detection and localization responses about briefly presented mammograms in which the spatial frequency, symmetry, and/or size of the images was manipulated. We show that the signal is stronger in the higher spatial frequencies. Performance does not depend on detection of breaks in the normal symmetry of left and right breasts. Moreover, above-chance classification is possible using images from the normal breast of a patient with overt signs of cancer only in the other breast. Some signal is present in the portions of the parenchyma (breast tissue) that do not contain a lesion or that are in the contralateral breast. This signal does not appear to be a simple assessment of breast density but rather the detection of the abnormal gist may be based on a widely distributed image statistic, learned by experts. The finding that a global signal, related to disease, can be detected in parenchyma that does not contain a lesion has implications for improving breast cancer detection.

Radiologists remember mountains better than radiographs, or do they?

Expertise with encoding material has been shown to aid long-term memory for that material. It is not clear how relevant this expertise is for image memorability (e.g., radiologists' memory for radiographs), and how robust over time. In two studies, we tested scene memory using a standard long-term memory paradigm. One compared the performance of radiologists to naïve observers on two image sets, chest radiographs and everyday scenes, and the other radiologists' memory with immediate as opposed to delayed recognition tests using musculoskeletal radiographs and forest scenes. Radiologists' memory was better than novices for images of expertise but no different for everyday scenes. With the heterogeneity of image sets equated, radiologists' expertise with radiographs afforded them better memory for the musculoskeletal radiographs than forest scenes. Enhanced memory for images of expertise disappeared over time, resulting in chance level performance for both image sets after weeks of delay. Expertise with the material is important for visual memorability but not to the same extent as idiosyncratic detail and variability of the image set. Similar memory decline with time for images of expertise as for everyday scenes further suggests that extended familiarity with an image is not a robust factor for visual memorability.

Computational assessment of visual search strategies in volumetric medical images.

When searching through volumetric images [e.g., computed tomography (CT)], radiologists appear to use two different search strategies: "drilling" (restrict eye movements to a small region of the image while quickly scrolling through slices), or "scanning" (search over large areas at a given depth before moving on to the next slice). To computationally identify the type of image information that is used in these two strategies, 23 naïve observers were instructed with either "drilling" or "scanning" when searching for target T's in 20 volumes of faux lung CTs. We computed saliency maps using both classical two-dimensional (2-D) saliency, and a three-dimensional (3-D) dynamic saliency that captures the characteristics of scrolling through slices. Comparing observers' gaze distributions with the saliency maps showed that search strategy alters the type of saliency that attracts fixations. Drillers' fixations aligned better with dynamic saliency and scanners with 2-D saliency. The computed saliency was greater for detected targets than for missed targets. Similar results were observed in data from 19 radiologists who searched five stacks of clinical chest CTs for lung nodules. Dynamic saliency may be superior to the 2-D saliency for detecting targets embedded in volumetric images, and thus "drilling" may be more efficient than "scanning."

Skeletal Muscle Metastasis from Renal Cell Carcinoma: 21 cases and review of the literature.

OBJECTIVES: This study aimed to raise radiologists' awareness of skeletal muscle metastases (SMM) in renal cell carcinoma (RCC) cases and to clarify their imaging appearance. METHODS: A retrospective analysis was undertaken of 21 patients between 44-75 years old with 72 SMM treated from January 1990 to May 2009 at the MD Anderson Cancer Center in Houston, Texas, USA. Additionally, 37 patients with 44 SMM from a literature review were analysed. RESULTS: Among the 21 patients, the majority of SMM were asymptomatic and detected via computed tomography (CT). Mean metastasis size was 18.3 mm and the most common site was the trunk muscles (83.3%). The interval between discovery of the primary tumour and metastasis detection ranged up to 234 months. Peripheral enhancement (47.1%) was the most common post-contrast CT pattern and non-contrasted CT lesions were often isodense. Magnetic resonance imaging (MRI) characteristics were varied. Five lesions with available T1-weighted pre-contrast images were hyperintense to the surrounding muscle. Other organ metastases were present in 20 patients. Of the 44 SMM reported in the literature, the majority were symptomatic. Average metastasis size was 53.4 mm and only 20.5% of SMM were in trunk muscles. The average interval between tumour discovery and metastasis detection was 101 months. Other organ metastases were recorded in 17 out of 29 patients. CONCLUSION: SMM should always be considered in patients with RCC, even well after primary treatment. SMM from RCC may be invisible on CT without intravenous contrast; contrast-enhanced studies are therefore recommended. SMM are often hyperintense to the surrounding muscle on T1-weighted MRI scans.

Radiologist experience effects on contrast detection.

Current literature shows that radiologist experience does not affect detection tasks when the object does not require medical training to detect. However, the research was never sufficiently detailed to examine if the contrast detection threshold is also the same for radiologists versus nonradiologists. Previously, contrast threshold research was performed predominantly on nonradiologists. Therefore, any differences could lead to over- or under-estimation of the performance capabilities of radiologists. Fourteen readers, evenly divided between radiologists and nonradiologists, read a set of 150 mammogram-like images. The study was performed with the location of the objects known and unknown, requiring two separate readings. No difference in the contrast detection threshold between reader groups for either the location-unknown (4.9 just noticeable differences) or location-known (3.3 just noticeable differences) images was seen. The standard deviation for the location-unknown condition had no difference (p 0.91). But for the location-known condition, a significant difference (p 0.0009) was seen between radiologists and nonradiologists. No difference in contrast detection based on reader experience was observed, but decreased variance was seen with radiologists in the location-known condition.