How does image quality affect radiologists' perceived ability for image interpretation and lesion detection in digital mammography?

OBJECTIVES: To study how radiologists' perceived ability to interpret digital mammography (DM) images is affected by decreases in image quality. METHODS: One view from 45 DM cases (including 30 cancers) was degraded to six levels each of two acquisition-related issues (lower spatial resolution and increased quantum noise) and three post-processing-related issues (lower and higher contrast and increased correlated noise) seen during clinical evaluation of DM systems. The images were shown to fifteen breast screening radiologists from five countries. Aware of lesion location, the radiologists selected the most-degraded mammogram (indexed from 1 (reference) to 7 (most degraded)) they still felt was acceptable for interpretation. The median selected index, per degradation type, was calculated separately for calcification and soft tissue (including normal) cases. Using the two-sided, non-parametric Mann-Whitney test, the median indices for each case and degradation type were compared. RESULTS: Radiologists were not tolerant to increases (medians: 1.5 (calcifications) and 2 (soft tissue)) or decreases (median: 2, for both types) in contrast, but were more tolerant to correlated noise (median: 3, for both types). Increases in quantum noise were tolerated more for calcifications than for soft tissue cases (medians: 3 vs. 4, p = 0.02). Spatial resolution losses were considered less acceptable for calcification detection than for soft tissue cases (medians: 3.5 vs. 5, p = 0.001). CONCLUSIONS: Perceived ability of radiologists for image interpretation in DM was affected not only by image acquisition-related issues but also by image post-processing issues, and some of those issues affected calcification cases more than soft tissue cases. KEY POINTS: • Lower spatial resolution and increased quantum noise affected the radiologists' perceived ability to interpret calcification cases more than soft tissue lesion or normal cases. • Post-acquisition image processing-related effects, not only image acquisition-related effects, also impact the perceived ability of radiologists to interpret images and detect lesions. • In addition to current practices, post-acquisition image processing-related effects need to also be considered during the testing and evaluation of digital mammography systems.

Development of an algorithm to convert mammographic images to appear as if acquired with different technique factors.

Purpose: We set out a fully developed algorithm for adapting mammography images to appear as if acquired using different technique factors by changing the signal and noise within the images. The algorithm accounts for difference between the absorption by the object being imaged and the imaging system. Approach: Images were acquired using a Hologic Selenia Dimensions x-ray unit for the validation, of three thicknesses of polymethyl methacrylate (PMMA) blocks with or without different thicknesses of PMMA contrast objects acquired for a range of technique factors. One set of images was then adapted to appear the same as a target image acquired with a higher or lower tube voltage and/or a different anode/filter combination. The average linearized pixel value, normalized noise power spectra (NNPS), and standard deviation of the flat field images and the contrast-to-noise ratio (CNR) of the contrast object images were calculated for the simulated and target images. A simulation study tested the algorithm on images created using a voxel breast phantom at different technique factors and the images compared using local signal level, variance, and power spectra. Results: The average pixel value, NNPS, and standard deviation for the simulated and target images were found to be within 9%. The CNRs of the simulated and target images were found to be within 5% of each other. The differences between the target and simulated images of the voxel phantom were similar to those of the natural variability. Conclusions: We demonstrated that images can be successfully adapted to appear as if acquired using different technique factors. Using this conversion algorithm, it may be possible to examine the effect of tube voltage and anode/filter combination on cancer detection using clinical images.

Validation of a mammographic image quality modification algorithm using 3D-printed breast phantoms.

Purpose: To validate a previously proposed algorithm that modifies a mammogram to appear as if it was acquired with different technique factors using realistic phantom-based mammograms. Approach: Two digital mammography systems (an indirect- and a direct-detector-based system) were used to acquire realistic mammographic images of five 3D-printed breast phantoms with the technique factors selected by the automatic exposure control and at various other conditions (denoted by the original images). Additional images under other simulated conditions were also acquired: higher or lower tube voltages, different anode/filter combinations, or lower tube current-time products (target images). The signal and noise in the original images were modified to simulate the target images (simulated images). The accuracy of the image modification algorithm was validated by comparing the target and simulated images using the local mean, local standard deviation (SD), local variance, and power spectra (PS) of the image signals. The absolute relative percent error between the target and simulated images for each parameter was calculated at each sub-region of interest (local parameters) and frequency (PS), and then averaged. Results: The local mean signal, local SD, local variance, and PS of the target and simulated images were very similar, with a relative percent error of 5.5%, 3.8%, 7.8%, and 4.4% (indirect system), respectively, and of 3.7%, 3.8%, 7.7%, and 7.5% (direct system), respectively. Conclusions: The algorithm is appropriate for simulating different technique factors. Therefore, it can be used in various studies, for instance to evaluate the impact of technique factors in cancer detection using clinical images.

Validation of a candidate instrument to assess image quality in digital mammography using ROC analysis.

PURPOSE: To validate a candidate instrument, to be used by different professionals to assess image quality in digital mammography (DM), against detection performance results. METHODS: A receiver operating characteristics (ROC) study was conducted to assess the detection performance in DM images with four different image quality levels due to different quality issues. Fourteen expert breast radiologists from five countries assessed a set of 80 DM cases, containing 60 lesions (40 cancers, 20 benign findings) and 20 normal cases. A visual grading analysis (VGA) study using a previously-described candidate instrument was conducted to evaluate a subset of 25 of the images used in the ROC study. Eight radiologists that had participated in the ROC study, and seven expert breast-imaging physicists, evaluated this subset. The VGA score (VGAS) and the ROC and visual grading characteristics (VGC) areas under the curve (AUCROC and AUCVGC) were compared. RESULTS: No large differences in image quality among the four levels were detected by either ROC or VGA studies. However, the ranking of the four levels was consistent: level 1 (partial AUCROC: 0.070, VGAS: 6.77) performed better than levels 2 (0.066, 6.15), 3 (0.061, 5.82), and 4 (0.062, 5.37). Similarity between radiologists' and physicists' assessments was found (average VGAS difference of 10 %). CONCLUSIONS: The results from the candidate instrument were found to correlate with those from ROC analysis, when used by either observer group. Therefore, it may be used by different professionals, such as radiologists, radiographers, and physicists, to assess clinically-relevant image quality variations in DM.

Development and content validity evaluation of a candidate instrument to assess image quality in digital mammography: A mixed-method study.

PURPOSE: To develop a candidate instrument to assess image quality in digital mammography, by identifying clinically relevant features in images that are affected by lower image quality. METHODS: Interviews with fifteen expert breast radiologists from five countries were conducted and analysed by using adapted directed content analysis. During these interviews, 45 mammographic cases, containing 44 lesions (30 cancers, 14 benign findings), and 5 normal cases, were shown with varying image quality. The interviews were performed to identify the structures from breast tissue and lesions relevant for image interpretation, and to investigate how image quality affected the visibility of those structures. The interview findings were used to develop tentative items, which were evaluated in terms of wording, understandability, and ambiguity with expert breast radiologists. The relevance of the tentative items was evaluated using the content validity index (CVI) and modified kappa index (k*). RESULTS: Twelve content areas, representing the content of image quality in digital mammography, emerged from the interviews and were converted into 29 tentative items. Fourteen of these items demonstrated excellent CVI ≥ 0.78 (k* > 0.74), one showed good CVI < 0.78 (0.60 ≤ k* ≤ 0.74), while fourteen were of fair or poor CVI < 0.78 (k* ≤ 0.59). In total, nine items were deleted and five were revised or combined resulting in 18 items. CONCLUSIONS: By following a mixed-method methodology, a candidate instrument was developed that may be used to characterise the clinically-relevant impact that image quality variations can have on digital mammography.

High-attenuation artifact reduction in breast tomosynthesis using a novel reconstruction algorithm.

PURPOSE: To assess the effect on reducing the out-of-plane artifacts from metal objects in breast tomosynthesis (BT) using a novel artifact-reducing reconstruction algorithm in specimen radiography. METHODS AND MATERIALS: The study was approved by the Regional Ethical Review Board. BT images of 18 partial- and whole mastectomy specimens from women with breast cancer were acquired before and after a needle was inserted close to the lesion. The images were reconstructed using both a standard reconstruction algorithm, and a novel algorithm; the latter uses pre-segmentation to remove highly attenuating artifact-inducing objects from projection images before reconstruction. Images were separately reconstructed with and without segmentation, and combined into an artifact-reduced reconstruction. Standard and artifact-reduced BT-algorithms were compared visually and quantitatively using clinical images of mastectomy specimens and a physical anthropomorphic phantom. Six readers independently assessed the visibility of the lesion with and without artifact-reduction in a side-by-side comparison. A quantitative analysis was performed, comparing the signal-difference to background ratio (SDBR) and artifact spread function (ASF) between the two reconstruction methods. RESULTS: The magnitude of out-of-plane artifacts was clearly reduced with the novel reconstruction compared to BT-images without artifact reduction. Lesion masking by artifacts was largely averted; tumour visibility was comparable to standard BT images without a needle. In 76 ± 8% (standard deviation) of cases overall, readers could confidently state needle location. The same figure was 94 ± 6% for whole mastectomy cases, compared to 62 ± 17% for partial mastectomies. With metal artifact reduction, SDBR increased by 97% in the phantom, and by 69% in the mastectomies. The artifact spread function was substantially narrower. CONCLUSION: Artifact reduction in BT using a novel reconstruction method enables qualitatively and quantitatively improved clinical use of BT when metal artifacts can be a limiting factor such as in tomosynthesis-guided biopsy.