Optimising the diagnostic accuracy of First post-contrAst SubtracTed breast MRI (FAST MRI) through interpretation-training: a multicentre e-learning study, mapping the learning curve of NHS Breast Screening Programme (NHSBSP) mammogram readers using an enriched dataset.

BACKGROUND: Abbreviated breast MRI (FAST MRI) is being introduced into clinical practice to screen women with mammographically dense breasts or with a personal history of breast cancer. This study aimed to optimise diagnostic accuracy through the adaptation of interpretation-training. METHODS: A FAST MRI interpretation-training programme (short presentations and guided hands-on workstation teaching) was adapted to provide additional training during the assessment task (interpretation of an enriched dataset of 125 FAST MRI scans) by giving readers feedback about the true outcome of each scan immediately after each scan was interpreted (formative assessment). Reader interaction with the FAST MRI scans used developed software (RiViewer) that recorded reader opinions and reading times for each scan. The training programme was additionally adapted for remote e-learning delivery. STUDY DESIGN: Prospective, blinded interpretation of an enriched dataset by multiple readers. RESULTS: 43 mammogram readers completed the training, 22 who interpreted breast MRI in their clinical role (Group 1) and 21 who did not (Group 2). Overall sensitivity was 83% (95%CI 81-84%; 1994/2408), specificity 94% (95%CI 93-94%; 7806/8338), readers' agreement with the true outcome kappa = 0.75 (95%CI 0.74-0.77) and diagnostic odds ratio = 70.67 (95%CI 61.59-81.09). Group 1 readers showed similar sensitivity (84%) to Group 2 (82% p = 0.14), but slightly higher specificity (94% v. 93%, p = 0.001). Concordance with the ground truth increased significantly with the number of FAST MRI scans read through the formative assessment task (p = 0.002) but by differing amounts depending on whether or not a reader had previously attended FAST MRI training (interaction p = 0.02). Concordance with the ground truth was significantly associated with reading batch size (p = 0.02), tending to worsen when more than 50 scans were read per batch. Group 1 took a median of 56 seconds (range 8-47,466) to interpret each FAST MRI scan compared with 78 (14-22,830, p < 0.0001) for Group 2. CONCLUSIONS: Provision of immediate feedback to mammogram readers during the assessment test set reading task increased specificity for FAST MRI interpretation and achieved high diagnostic accuracy. Optimal reading-batch size for FAST MRI was 50 reads per batch. Trial registration (25/09/2019): ISRCTN16624917.

Evaluating the effectiveness of abbreviated breast MRI (abMRI) interpretation training for mammogram readers: a multi-centre study assessing diagnostic performance, using an enriched dataset.

BACKGROUND: Abbreviated breast MRI (abMRI) is being introduced in breast screening trials and clinical practice, particularly for women with dense breasts. Upscaling abMRI provision requires the workforce of mammogram readers to learn to effectively interpret abMRI. The purpose of this study was to examine the diagnostic accuracy of mammogram readers to interpret abMRI after a single day of standardised small-group training and to compare diagnostic performance of mammogram readers experienced in full-protocol breast MRI (fpMRI) interpretation (Group 1) with that of those without fpMRI interpretation experience (Group 2). METHODS: Mammogram readers were recruited from six NHS Breast Screening Programme sites. Small-group hands-on workstation training was provided, with subsequent prospective, independent, blinded interpretation of an enriched dataset with known outcome. A simplified form of abMRI (first post-contrast subtracted images (FAST MRI), displayed as maximum-intensity projection (MIP) and subtracted slice stack) was used. Per-breast and per-lesion diagnostic accuracy analysis was undertaken, with comparison across groups, and double-reading simulation of a consecutive screening subset. RESULTS: 37 readers (Group 1: 17, Group 2: 20) completed the reading task of 125 scans (250 breasts) (total = 9250 reads). Overall sensitivity was 86% (95% confidence interval (CI) 84-87%; 1776/2072) and specificity 86% (95%CI 85-86%; 6140/7178). Group 1 showed significantly higher sensitivity (843/952; 89%; 95%CI 86-91%) and higher specificity (2957/3298; 90%; 95%CI 89-91%) than Group 2 (sensitivity = 83%; 95%CI 81-85% (933/1120) p < 0.0001; specificity = 82%; 95%CI 81-83% (3183/3880) p < 0.0001). Inter-reader agreement was higher for Group 1 (kappa = 0.73; 95%CI 0.68-0.79) than for Group 2 (kappa = 0.51; 95%CI 0.45-0.56). Specificity improved for Group 2, from the first 55 cases (81%) to the remaining 70 (83%) (p = 0.02) but not for Group 1 (90-89% p = 0.44), whereas sensitivity remained consistent for both Group 1 (88-89%) and Group 2 (83-84%). CONCLUSIONS: Single-day abMRI interpretation training for mammogram readers achieved an overall diagnostic performance within benchmarks published for fpMRI but was insufficient for diagnostic accuracy of mammogram readers new to breast MRI to match that of experienced fpMRI readers. Novice MRI reader performance improved during the reading task, suggesting that additional training could further narrow this performance gap.

Virtual clinical trial to compare cancer detection using combinations of 2D mammography, digital breast tomosynthesis and synthetic 2D imaging.

OBJECTIVES: This study was designed to compare the detection of subtle lesions (calcification clusters or masses) when using the combination of digital breast tomosynthesis (DBT) and synthetic mammography (SM) with digital mammography (DM) alone or combined with DBT. METHODS: A set of 166 cases without cancer was acquired on a DBT mammography system. Realistic subtle calcification clusters and masses in the DM images and DBT planes were digitally inserted into 104 of the acquired cases. Three study arms were created: DM alone, DM with DBT and SM with DBT. Five mammographic readers located the centre of any lesion within the images that should be recalled for further investigation and graded their suspiciousness. A JAFROC figure of merit (FoM) and lesion detection fraction (LDF) were calculated for each study arm. The visibility of the lesions in the DBT images was compared with SM and DM images. RESULTS: For calcification clusters, there were no significant differences (p > 0.075) in FoM or LDF. For masses, the FoM and LDF were significantly improved in the arms using DBT compared to DM alone (p < 0.001). On average, both calcification clusters and masses were more visible on DBT than on DM and SM images. CONCLUSIONS: This study demonstrated that masses were detected better with DBT than with DM alone and there was no significant difference (p = 0.075) in LDF between DM&DBT and SM&DBT for calcifications clusters. Our results support previous studies that it may be acceptable to not acquire digital mammography alongside tomosynthesis for subtle calcification clusters and ill-defined masses. KEY POINTS: • The detection of masses was significantly better using DBT than with digital mammography alone. • The detection of calcification clusters was not significantly different between digital mammography and synthetic 2D images combined with tomosynthesis. • Our results support previous studies that it may be acceptable to not acquire digital mammography alongside tomosynthesis for subtle calcification clusters and ill-defined masses for the imaging technology used.

Effect of glandularity on the detection of simulated cancers in planar, tomosynthesis, and synthetic 2D imaging of the breast using a hybrid virtual clinical trial.

PURPOSE: The purpose of this study was to measure the threshold diameter of calcifications and masses for 2D imaging, digital breast tomosynthesis (DBT), and synthetic 2D images, for a range of breast glandularities. This study shows the limits of detection for each of the technologies and the strengths and weaknesses of each in terms of visualizing the radiological features of small cancers. METHODS: Mathematical voxel breast phantoms with glandularities by volume of 9%, 18%, and 30% with a thickness of 53 mm were created. Simulated ill-defined masses and calcification clusters with a range of diameters were inserted into some of these breast models. The imaging characteristics of a Siemens Inspiration X-ray system were measured for a 29 kV, tungsten/rhodium anode/filter combination. Ray tracing through the breast models was undertaken to create simulated 2D and DBT projection images. These were then modified to adjust the image sharpness, and to add scatter and noise. The mean glandular doses for the images were 1.43, 1.47, and 1.47 mGy for 2D and 1.92, 1.97, and 1.98 mGy for DBT for the three glandularities. The resultant images were processed to create 2D, DBT planes and synthetic 2D images. Patches of the images with or without a simulated lesion were extracted, and used in a four-alternative forced choice study to measure the threshold diameters for each imaging mode, lesion type, and glandularity. The study was undertaken by six physicists. RESULTS: The threshold diameters of the lesions were 6.2, 4.9, and 6.7 mm (masses) and 225, 370, and 399 µm, (calcifications) for 2D, DBT, and synthetic 2D, respectively, for a breast glandularity of 18%. The threshold diameter of ill-defined masses is significantly smaller for DBT than for both 2D (p≤0.006) and synthetic 2D (p≤0.012) for all glandularities. Glandularity has a significant effect on the threshold diameter of masses, even for DBT where there is reduced background structure in the images. The calcification threshold diameters for 2D images were significantly smaller than for DBT and synthetic 2D for all glandularities. There were few significant differences for the threshold diameter of calcifications between glandularities, indicating that the background structure has little effect on the detection of calcifications. We measured larger but nonsignificant differences in the threshold diameters for synthetic 2D imaging than for 2D imaging for masses in the 9% (p = 0.059) and 18% (p = 0.19) glandularities. The threshold diameters for synthetic 2D imaging were larger than for 2D imaging for calcifications (p < 0.001) for all glandularities. CONCLUSIONS: We have shown that glandularity has only a small effect on the detection of calcifications, but the threshold diameter of masses was significantly larger for higher glandularity for all of the modalities tested. We measured nonsignificantly larger threshold diameters for synthetic 2D imaging than for 2D imaging for masses at the 9% (p = 0.059) and 18% (p = 0.19) glandularities and significantly larger diameters for calcifications (p < 0.001) for all glandularities. The lesions simulated were very subtle and further work is required to examine the clinical effect of not seeing the smallest calcifications in clusters.

The threshold detectable mass diameter for 2D-mammography and digital breast tomosynthesis.

Digital breast tomosynthesis (DBT) is currently under consideration for replacement of, or combined use with 2D-mammography in national breast screening programmes. To investigate the potential benefits that DBT can bring to screening, the threshold detectable lesion diameters were measured for different forms of DBT in comparison to 2D-mammography. The aim of this study was to compare the threshold detectable mass diameters obtained with narrow angle (15°/15 projections) and wide angle (50°/25 projections) DBT in comparison to 2D-mammography. Simulated images of 60 mm thick compressed breasts were produced with and without masses using a set of validated image modelling tools for 2D-mammography and DBT. Image processing and reconstruction were performed using commercial software. A series of 4-alternative forced choice (4AFC) experiments was conducted for signal detection with the masses as targets. The threshold detectable mass diameter was found for each imaging modality with a mean glandular dose of 2.5 mGy. The resulting values of the threshold diameter for 2D-mammography (10.2 ±â€¯1.4 mm) were found to be larger (p < 0.001) than those for narrow angle DBT (6.0 ±â€¯1.1 mm) and wide angle DBT (5.6 ±â€¯1.2 mm). There was no significant difference between the threshold diameters for wide and narrow angle DBT. Implications for the introduction of DBT alone or in combination with 2D-mammography in breast cancer screening are discussed.

Simple method for computing scattered radiation in breast tomosynthesis.

PURPOSE: Virtual clinical trials (VCT) are a powerful imaging tool that can be used to investigate digital breast tomosynthesis (DBT) technology. In this work, a fast and simple method is proposed to estimate the two-dimensional distribution of scattered radiation which is needed when simulating DBT geometries in VCTs. METHODS: Monte Carlo simulations are used to precalculate scatter-to-primary ratio (SPR) for a range of low-resolution homogeneous phantoms. The resulting values can be used to estimate the two-dimensional (2D) distribution of scattered radiation arising from inhomogeneous anthropomorphic phantoms used in VCTs. The method has been validated by comparing the values of the scatter thus obtained against the results of direct Monte Carlo simulation for three different types of inhomogeneous anthropomorphic phantoms. RESULTS: Differences between the proposed scatter field estimation method and the ground truth data for the OPTIMAM phantom had an average modulus and standard deviation of over the projected breast area of 2.4 ± 0.9% (minimum -17.0%, maximum 27.7%). The corresponding values for the University of Pennsylvania and Duke University breast phantoms were 1.8 ± 0.1% (minimum -8.7%, maximum 8.0%) and 5.1 ± 0.1% (minimum -16.2%, maximum 7.4%), respectively. CONCLUSIONS: The proposed method, which has been validated using three of the most common breast models, is a useful tool for accurately estimating scattered radiation in VCT schemes used to study current designs of DBT system.

Lesion detectability in 2D-mammography and digital breast tomosynthesis using different targets and observers.

This work investigates the detection performance of specialist and non-specialist observers for different targets in 2D-mammography and digital breast tomosynthesis (DBT) using the OPTIMAM virtual clinical trials (VCT) Toolbox and a 4-alternative forced choice (4AFC) assessment paradigm. Using 2D-mammography and DBT images of virtual breast phantoms, we compare the detection limits of simple uniform spherical targets and irregular solid masses. Target diameters of 4 mm and 6 mm have been chosen to represent target sizes close to the minimum detectable size found in breast screening, across a range of controlled contrast levels. The images were viewed by a set of specialist observers (five medical physicists and six experienced clinical readers) and five non-specialists. Combined results from both observer groups indicate that DBT has a significantly lower detectable threshold contrast than 2D-mammography for small masses (4 mm: 2.1% [DBT] versus 6.9% [2D]; 6 mm: 0.7% [DBT] versus 3.9% [2D]) and spheres (4 mm: 2.9% [DBT] versus 5.3% [2D]; 6 mm: 0.3% [DBT] versus 2.2% [2D]) (p < 0.0001). Both observer groups found spheres significantly easier to detect than irregular solid masses for both sizes and modalities (p < 0.0001) (except 4 mm DBT). The detection performances of specialist and non-specialist observers were generally found to be comparable, where each group marginally outperformed the other in particular detection tasks. Within the specialist group, the clinical readers performed better than the medical physicists with irregular masses (p < 0.0001). The results indicate that using spherical targets in such studies may produce over-optimistic detection thresholds compared to more complex masses, and that the superiority of DBT for detecting masses over 2D-mammography has been quantified. The results also suggest specialist observers may be supplemented by non-specialist observers (with training) in some types of 4AFC studies.

The effect of system geometry and dose on the threshold detectable calcification diameter in 2D-mammography and digital breast tomosynthesis.

Digital breast tomosynthesis (DBT) is under consideration to replace or to be used in combination with 2D-mammography in breast screening. The aim of this study was the comparison of the detection of microcalcification clusters by human observers in simulated breast images using 2D-mammography, narrow angle (15°/15 projections) and wide angle (50°/25 projections) DBT. The effects of the cluster height in the breast and the dose to the breast on calcification detection were also tested. Simulated images of 6 cm thick compressed breasts were produced with and without microcalcification clusters inserted, using a set of image modelling tools for 2D-mammography and DBT. Image processing and reconstruction were performed using commercial software. A series of 4-alternative forced choice (4AFC) experiments was conducted for signal detection with the microcalcification clusters as targets. Threshold detectable calcification diameter was found for each imaging modality with standard dose: 2D-mammography: 2D-mammography (165 ± 9 µm), narrow angle DBT (211 ± 11 µm) and wide angle DBT (257 ± 14 µm). Statistically significant differences were found when using different doses, but different geometries had a greater effect. No differences were found between the threshold detectable calcification diameters at different heights in the breast. Calcification clusters may have a lower detectability using DBT than 2D imaging.

Design and validation of realistic breast models for use in multiple alternative forced choice virtual clinical trials.

A novel method has been developed for generating quasi-realistic voxel phantoms which simulate the compressed breast in mammography and digital breast tomosynthesis (DBT). The models are suitable for use in virtual clinical trials requiring realistic anatomy which use the multiple alternative forced choice (AFC) paradigm and patches from the complete breast image. The breast models are produced by extracting features of breast tissue components from DBT clinical images including skin, adipose and fibro-glandular tissue, blood vessels and Cooper's ligaments. A range of different breast models can then be generated by combining these components. Visual realism was validated using a receiver operating characteristic (ROC) study of patches from simulated images calculated using the breast models and from real patient images. Quantitative analysis was undertaken using fractal dimension and power spectrum analysis. The average areas under the ROC curves for 2D and DBT images were 0.51 ± 0.06 and 0.54 ± 0.09 demonstrating that simulated and real images were statistically indistinguishable by expert breast readers (7 observers); errors represented as one standard error of the mean. The average fractal dimensions (2D, DBT) for real and simulated images were (2.72 ± 0.01, 2.75 ± 0.01) and (2.77 ± 0.03, 2.82 ± 0.04) respectively; errors represented as one standard error of the mean. Excellent agreement was found between power spectrum curves of real and simulated images, with average ß values (2D, DBT) of (3.10 ± 0.17, 3.21 ± 0.11) and (3.01 ± 0.32, 3.19 ± 0.07) respectively; errors represented as one standard error of the mean. These results demonstrate that radiological images of these breast models realistically represent the complexity of real breast structures and can be used to simulate patches from mammograms and DBT images that are indistinguishable from patches from the corresponding real breast images. The method can generate about 500 radiological patches (~30 mm × 30 mm) per day for AFC experiments on a single workstation. This is the first study to quantitatively validate the realism of simulated radiological breast images using direct blinded comparison with real data via the ROC paradigm with expert breast readers.

Development and validation of a modelling framework for simulating 2D-mammography and breast tomosynthesis images.

Planar 2D x-ray mammography is generally accepted as the preferred screening technique used for breast cancer detection. Recently, digital breast tomosynthesis (DBT) has been introduced to overcome some of the inherent limitations of conventional planar imaging, and future technological enhancements are expected to result in the introduction of further innovative modalities. However, it is crucial to understand the impact of any new imaging technology or methodology on cancer detection rates and patient recall. Any such assessment conventionally requires large scale clinical trials demanding significant investment in time and resources. The concept of virtual clinical trials and virtual performance assessment may offer a viable alternative to this approach. However, virtual approaches require a collection of specialized modelling tools which can be used to emulate the image acquisition process and simulate images of a quality indistinguishable from their real clinical counterparts. In this paper, we present two image simulation chains constructed using modelling tools that can be used for the evaluation of 2D-mammography and DBT systems. We validate both approaches by comparing simulated images with real images acquired using the system being simulated. A comparison of the contrast-to-noise ratios and image blurring for real and simulated images of test objects shows good agreement ( < 9% error). This suggests that our simulation approach is a promising alternative to conventional physical performance assessment followed by large scale clinical trials.