Robustness of radiomic features in healthy abdominal parenchyma of patients with repeated examinations on dual-layer dual-energy CT.

OBJECTIVES: Robustness of radiomic features in physiological tissue is an important prerequisite for quantitative analysis of tumor biology and response assessment. In contrast to previous studies which focused on different tumors with mostly short scan-re-scan intervals, this study aimed to evaluate the robustness of radiomic features in cancer-free patients and over a clinically encountered inter-scan interval. MATERIALS AND METHODS: Patients without visible tumor burden who underwent at least two portal-venous phase dual energy CT examinations of the abdomen between May 2016 and January 2020 were included, while macroscopic tumor burden was excluded based upon follow-up imaging for all patients (≥3 months). Further, patients were excluded if no follow-up imaging was available, or if the CT protocol showed deviations between repeated examinations. Circular regions of interest were placed and proofread by two board-certified radiologists (4 years and 5 years experience) within the liver (segments 3 and 6), the psoas muscle (left and right), the pancreatic head, and the spleen to obtain radiomic features from normal-appearing organ parenchyma using PyRadiomics. Radiomic feature robustness was tested using the concordance correlation coefficient with a threshold of 0.75 considered indicative for deeming a feature robust. RESULTS: In total, 160 patients with 480 repeated abdominal CT examinations (range: 2-4 per patient) were retrospectively included in this single-center, IRB-approved study. Considering all organs and feature categories, only 4.58 % (25/546) of all features were robust with the highest rate being found in the first order feature category (20.37 %, 22/108). Other feature categories (grey level co-occurrence matrix, grey level dependence matrix, grey level run length matrix, grey level size zone matrix, and neighborhood gray-tone difference matrix) yielded an overall low percentage of robust features (range: 0.00 %-1.19 %). A subgroup analysis revealed the reconstructed field of view and the X-ray tube current as determinants of feature robustness (significant differences in subgroups for all organs, p < 0.001) as well as the size of the region of interest (no significant difference for the pancreatic head with p = 0.135, significant difference with p < 0.001 for all other organs). CONCLUSION: Radiomic feature robustness obtained from cancer-free subjects with repeated examinations using a consistent protocol and CT scanner was limited, with first order features yielding the highest proportion of robust features.

Native myocardial T1 mapping: influence of spatial resolution on quantitative results and reproducibility.

Background: Myocardial mapping techniques can be used to quantitatively assess alterations in myocardial tissue properties. This study aims to evaluate the influence of spatial resolution on quantitative results and reproducibility of native myocardial T1 mapping in cardiac magnetic resonance imaging (MRI). Methods: In this cross-sectional study with prospective data collection between October 2019 and February 2020, 50 healthy adults underwent two identical cardiac MRI examinations in the radiology department on the same day. T1 mapping was performed using a MOLLI 5(3)3 sequence with higher (1.4 mm × 1.4 mm) and lower (1.9 mm × 1.9 mm) in-plane spatial resolution. Global quantitative results of T1 mapping were compared between high-resolution and low-resolution acquisitions using paired t-test. Intra-class correlation coefficient (ICC) and Bland-Altman statistics (absolute and percentage differences as means ± SD) were used for assessing test-retest reproducibility. Results: There was no significant difference between global quantitative results acquired with high vs. low-resolution T1 mapping. The reproducibility of global T1 values was good for high-resolution (ICC: 0.88) and excellent for low-resolution T1 mapping (ICC: 0.95, P=0.003). In subgroup analyses, inferior test-retest reproducibility was observed for high spatial resolution in women compared to low spatial resolution (ICC: 0.71 vs. 0.91, P=0.001) and heart rates >77 bpm (ICC: 0.53 vs. 0.88, P=0.004). Apical segments had higher T1 values and variability compared to other segments. Regional T1 values for basal (ICC: 0.81 vs. 0.89, P=0.023) and apical slices (ICC: 0.86 vs. 0.92, P=0.024) showed significantly higher reproducibility in low-resolution compared to high-resolution acquisitions but without differences for midventricular slice (ICC: 0.91 vs. 0.92, P=0.402). Conclusions: Based on our data, we recommend a spatial resolution on the order of 1.9 mm × 1.9 mm for native myocardial T1 mapping using a MOLLI 5(3)3 sequence at 1.5 T particularly in individuals with higher heart rates and women.

METhodological RadiomICs Score (METRICS): a quality scoring tool for radiomics research endorsed by EuSoMII.

PURPOSE: To propose a new quality scoring tool, METhodological RadiomICs Score (METRICS), to assess and improve research quality of radiomics studies. METHODS: We conducted an online modified Delphi study with a group of international experts. It was performed in three consecutive stages: Stage#1, item preparation; Stage#2, panel discussion among EuSoMII Auditing Group members to identify the items to be voted; and Stage#3, four rounds of the modified Delphi exercise by panelists to determine the items eligible for the METRICS and their weights. The consensus threshold was 75%. Based on the median ranks derived from expert panel opinion and their rank-sum based conversion to importance scores, the category and item weights were calculated. RESULT: In total, 59 panelists from 19 countries participated in selection and ranking of the items and categories. Final METRICS tool included 30 items within 9 categories. According to their weights, the categories were in descending order of importance: study design, imaging data, image processing and feature extraction, metrics and comparison, testing, feature processing, preparation for modeling, segmentation, and open science. A web application and a repository were developed to streamline the calculation of the METRICS score and to collect feedback from the radiomics community. CONCLUSION: In this work, we developed a scoring tool for assessing the methodological quality of the radiomics research, with a large international panel and a modified Delphi protocol. With its conditional format to cover methodological variations, it provides a well-constructed framework for the key methodological concepts to assess the quality of radiomic research papers. CRITICAL RELEVANCE STATEMENT: A quality assessment tool, METhodological RadiomICs Score (METRICS), is made available by a large group of international domain experts, with transparent methodology, aiming at evaluating and improving research quality in radiomics and machine learning. KEY POINTS: • A methodological scoring tool, METRICS, was developed for assessing the quality of radiomics research, with a large international expert panel and a modified Delphi protocol. • The proposed scoring tool presents expert opinion-based importance weights of categories and items with a transparent methodology for the first time. • METRICS accounts for varying use cases, from handcrafted radiomics to entirely deep learning-based pipelines. • A web application has been developed to help with the calculation of the METRICS score ( https://metricsscore.github.io/metrics/METRICS.html ) and a repository created to collect feedback from the radiomics community ( https://github.com/metricsscore/metrics ).

Towards reproducible radiomics research: introduction of a database for radiomics studies.

OBJECTIVES: To investigate the model-, code-, and data-sharing practices in the current radiomics research landscape and to introduce a radiomics research database. METHODS: A total of 1254 articles published between January 1, 2021, and December 31, 2022, in leading radiology journals (European Radiology, European Journal of Radiology, Radiology, Radiology: Artificial Intelligence, Radiology: Cardiothoracic Imaging, Radiology: Imaging Cancer) were retrospectively screened, and 257 original research articles were included in this study. The categorical variables were compared using Fisher's exact tests or chi-square test and numerical variables using Student's t test with relation to the year of publication. RESULTS: Half of the articles (128 of 257) shared the model by either including the final model formula or reporting the coefficients of selected radiomics features. A total of 73 (28%) models were validated on an external independent dataset. Only 16 (6%) articles shared the data or used publicly available open datasets. Similarly, only 20 (7%) of the articles shared the code. A total of 7 (3%) articles both shared code and data. All collected data in this study is presented in a radiomics research database (RadBase) and could be accessed at https://github.com/EuSoMII/RadBase . CONCLUSION: According to the results of this study, the majority of published radiomics models were not technically reproducible since they shared neither model nor code and data. There is still room for improvement in carrying out reproducible and open research in the field of radiomics. CLINICAL RELEVANCE STATEMENT: To date, the reproducibility of radiomics research and open science practices within the radiomics research community are still very low. Ensuring reproducible radiomics research with model-, code-, and data-sharing practices will facilitate faster clinical translation. KEY POINTS: • There is a discrepancy between the number of published radiomics papers and the clinical implementation of these published radiomics models. • The main obstacle to clinical implementation is the lack of model-, code-, and data-sharing practices. • In order to translate radiomics research into clinical practice, the radiomics research community should adopt open science practices.

The challenges of research data management in cardiovascular science: a DGK and DZHK position paper-executive summary.

The sharing and documentation of cardiovascular research data are essential for efficient use and reuse of data, thereby aiding scientific transparency, accelerating the progress of cardiovascular research and healthcare, and contributing to the reproducibility of research results. However, challenges remain. This position paper, written on behalf of and approved by the German Cardiac Society and German Centre for Cardiovascular Research, summarizes our current understanding of the challenges in cardiovascular research data management (RDM). These challenges include lack of time, awareness, incentives, and funding for implementing effective RDM; lack of standardization in RDM processes; a need to better identify meaningful and actionable data among the increasing volume and complexity of data being acquired; and a lack of understanding of the legal aspects of data sharing. While several tools exist to increase the degree to which data are findable, accessible, interoperable, and reusable (FAIR), more work is needed to lower the threshold for effective RDM not just in cardiovascular research but in all biomedical research, with data sharing and reuse being factored in at every stage of the scientific process. A culture of open science with FAIR research data should be fostered through education and training of early-career and established research professionals. Ultimately, FAIR RDM requires permanent, long-term effort at all levels. If outcomes can be shown to be superior and to promote better (and better value) science, modern RDM will make a positive difference to cardiovascular science and practice. The full position paper is available in the supplementary materials.

Addressing challenges in radiomics research: systematic review and repository of open-access cancer imaging datasets.

OBJECTIVES: Open-access cancer imaging datasets have become integral for evaluating novel AI approaches in radiology. However, their use in quantitative analysis with radiomics features presents unique challenges, such as incomplete documentation, low visibility, non-uniform data formats, data inhomogeneity, and complex preprocessing. These issues may cause problems with reproducibility and standardization in radiomics studies. METHODS: We systematically reviewed imaging datasets with public copyright licenses, published up to March 2023 across four large online cancer imaging archives. We included only datasets with tomographic images (CT, MRI, or PET), segmentations, and clinical annotations, specifically identifying those suitable for radiomics research. Reproducible preprocessing and feature extraction were performed for each dataset to enable their easy reuse. RESULTS: We discovered 29 datasets with corresponding segmentations and labels in the form of health outcomes, tumor pathology, staging, imaging-based scores, genetic markers, or repeated imaging. We compiled a repository encompassing 10,354 patients and 49,515 scans. Of the 29 datasets, 15 were licensed under Creative Commons licenses, allowing both non-commercial and commercial usage and redistribution, while others featured custom or restricted licenses. Studies spanned from the early 1990s to 2021, with the majority concluding after 2013. Seven different formats were used for the imaging data. Preprocessing and feature extraction were successfully performed for each dataset. CONCLUSION: RadiomicsHub is a comprehensive public repository with radiomics features derived from a systematic review of public cancer imaging datasets. By converting all datasets to a standardized format and ensuring reproducible and traceable processing, RadiomicsHub addresses key reproducibility and standardization challenges in radiomics. CRITICAL RELEVANCE STATEMENT: This study critically addresses the challenges associated with locating, preprocessing, and extracting quantitative features from open-access datasets, to facilitate more robust and reliable evaluations of radiomics models. KEY POINTS: - Through a systematic review, we identified 29 cancer imaging datasets suitable for radiomics research. - A public repository with collection overview and radiomics features, encompassing 10,354 patients and 49,515 scans, was compiled. - Most datasets can be shared, used, and built upon freely under a Creative Commons license. - All 29 identified datasets have been converted into a common format to enable reproducible radiomics feature extraction.

Deep Learning k-Space-to-Image Reconstruction Facilitates High Spatial Resolution and Scan Time Reduction in Diffusion-Weighted Imaging Breast MRI.

BACKGROUND: For time-consuming diffusion-weighted imaging (DWI) of the breast, deep learning-based imaging acceleration appears particularly promising. PURPOSE: To investigate a combined k-space-to-image reconstruction approach for scan time reduction and improved spatial resolution in breast DWI. STUDY TYPE: Retrospective. POPULATION: 133 women (age 49.7 ± 12.1 years) underwent multiparametric breast MRI. FIELD STRENGTH/SEQUENCE: 3.0T/T2 turbo spin echo, T1 3D gradient echo, DWI (800 and 1600 sec/mm2 ). ASSESSMENT: DWI data were retrospectively processed using deep learning-based k-space-to-image reconstruction (DL-DWI) and an additional super-resolution algorithm (SRDL-DWI). In addition to signal-to-noise ratio and apparent diffusion coefficient (ADC) comparisons among standard, DL- and SRDL-DWI, a range of quantitative similarity (e.g., structural similarity index [SSIM]) and error metrics (e.g., normalized root mean square error [NRMSE], symmetric mean absolute percent error [SMAPE], log accuracy error [LOGAC]) was calculated to analyze structural variations. Subjective image evaluation was performed independently by three radiologists on a seven-point rating scale. STATISTICAL TESTS: Friedman's rank-based analysis of variance with Bonferroni-corrected pairwise post-hoc tests. P < 0.05 was considered significant. RESULTS: Both DL- and SRDL-DWI allowed for a 39% reduction in simulated scan time over standard DWI (5 vs. 3 minutes). The highest image quality ratings were assigned to SRDL-DWI with good interreader agreement (ICC 0.834; 95% confidence interval 0.818-0.848). Irrespective of b-value, both standard and DL-DWI produced superior SNR compared to SRDL-DWI. ADC values were slightly higher in SRDL-DWI (+0.5%) and DL-DWI (+3.4%) than in standard DWI. Structural similarity was excellent between DL-/SRDL-DWI and standard DWI for either b value (SSIM ≥ 0.86). Calculation of error metrics (NRMSE ≤ 0.05, SMAPE ≤ 0.02, and LOGAC ≤ 0.04) supported the assumption of low voxel-wise error. DATA CONCLUSION: Deep learning-based k-space-to-image reconstruction reduces simulated scan time of breast DWI by 39% without influencing structural similarity. Additionally, super-resolution interpolation allows for substantial improvement of subjective image quality. EVIDENCE LEVEL: 4 TECHNICAL EFFICACY: Stage 1.

Automated localization and segmentation of cervical lymph nodes on contrast-enhanced CT using a 3D foveal fully convolutional neural network.

BACKGROUND: In the management of cancer patients, determination of TNM status is essential for treatment decision-making and therefore closely linked to clinical outcome and survival. Here, we developed a tool for automatic three-dimensional (3D) localization and segmentation of cervical lymph nodes (LNs) on contrast-enhanced computed tomography (CECT) examinations. METHODS: In this IRB-approved retrospective single-center study, 187 CECT examinations of the head and neck region from patients with various primary diseases were collected from our local database, and 3656 LNs (19.5 ± 14.9 LNs/CECT, mean ± standard deviation) with a short-axis diameter (SAD) ≥ 5 mm were segmented manually by expert physicians. With these data, we trained an independent fully convolutional neural network based on 3D foveal patches. Testing was performed on 30 independent CECTs with 925 segmented LNs with an SAD ≥ 5 mm. RESULTS: In total, 4,581 LNs were segmented in 217 CECTs. The model achieved an average localization rate (LR), i.e., percentage of localized LNs/CECT, of 78.0% in the validation dataset. In the test dataset, average LR was 81.1% with a mean Dice coefficient of 0.71. For enlarged LNs with a SAD ≥ 10 mm, LR was 96.2%. In the test dataset, the false-positive rate was 2.4 LNs/CECT. CONCLUSIONS: Our trained AI model demonstrated a good overall performance in the consistent automatic localization and 3D segmentation of physiological and metastatic cervical LNs with a SAD ≥ 5 mm on CECTs. This could aid clinical localization and automatic 3D segmentation, which can benefit clinical care and radiomics research. RELEVANCE STATEMENT: Our AI model is a time-saving tool for 3D segmentation of cervical lymph nodes on contrast-enhanced CT scans and serves as a solid base for N staging in clinical practice and further radiomics research. KEY POINTS: • Determination of N status in TNM staging is essential for therapy planning in oncology. • Segmenting cervical lymph nodes manually is highly time-consuming in clinical practice. • Our model provides a robust, automated 3D segmentation of cervical lymph nodes. • It achieves a high accuracy for localization especially of enlarged lymph nodes. • These segmentations should assist clinical care and radiomics research.

Trends and statistics of artificial intelligence and radiomics research in Radiology, Nuclear Medicine, and Medical Imaging: bibliometric analysis.

OBJECTIVE: To conduct a comprehensive bibliometric analysis of artificial intelligence (AI) and its subfields as well as radiomics in Radiology, Nuclear Medicine, and Medical Imaging (RNMMI). METHODS: Web of Science was queried for relevant publications in RNMMI and medicine along with their associated data from 2000 to 2021. Bibliometric techniques utilised were co-occurrence, co-authorship, citation burst, and thematic evolution analyses. Growth rate and doubling time were also estimated using log-linear regression analyses. RESULTS: According to the number of publications, RNMMI (11,209; 19.8%) was the most prominent category in medicine (56,734). USA (44.6%) and China (23.1%) were the two most productive and collaborative countries. USA and Germany experienced the strongest citation bursts. Thematic evolution has recently exhibited a significant shift toward deep learning. In all analyses, the annual number of publications and citations demonstrated exponential growth, with deep learning-based publications exhibiting the most prominent growth pattern. Estimated continuous growth rate, annual growth rate, and doubling time of the AI and machine learning publications in RNMMI were 26.1% (95% confidence interval [CI], 12.0-40.2%), 29.8% (95% CI, 12.7-49.5%), and 2.7 years (95% CI, 1.7-5.8), respectively. In the sensitivity analysis using data from the last 5 and 10 years, these estimates ranged from 47.6 to 51.1%, 61.0 to 66.7%, and 1.4 to 1.5 years. CONCLUSION: This study provides an overview of AI and radiomics research conducted mainly in RNMMI. These results may assist researchers, practitioners, policymakers, and organisations in gaining a better understanding of both the evolution of these fields and the importance of supporting (e.g., financial) these research activities. KEY POINTS: • In terms of the number of publications on AI and ML, Radiology, Nuclear Medicine, and Medical Imaging was the most prominent category compared to the other categories related to medicine (e.g., Health Policy & Services, Surgery). • All evaluated analyses (i.e., AI, its subfields, and radiomics), based on the annual number of publications and citations, demonstrated exponential growth, with decreasing doubling time, which indicates increasing interest from researchers, journals, and, in turn, the medical imaging community. • The most prominent growth pattern was observed in deep learning-based publications. However, the further thematic analysis demonstrated that deep learning has been underdeveloped but highly relevant to the medical imaging community.

Transfer-Learning Deep Radiomics and Hand-Crafted Radiomics for Classifying Lymph Nodes from Contrast-Enhanced Computed Tomography in Lung Cancer.

OBJECTIVES: Positron emission tomography (PET) is currently considered the non-invasive reference standard for lymph node (N-)staging in lung cancer. However, not all patients can undergo this diagnostic procedure due to high costs, limited availability, and additional radiation exposure. The purpose of this study was to predict the PET result from traditional contrast-enhanced computed tomography (CT) and to test different feature extraction strategies. METHODS: In this study, 100 lung cancer patients underwent a contrast-enhanced 18F-fluorodeoxyglucose (FDG) PET/CT scan between August 2012 and December 2019. We trained machine learning models to predict FDG uptake in the subsequent PET scan. Model inputs were composed of (i) traditional "hand-crafted" radiomics features from the segmented lymph nodes, (ii) deep features derived from a pretrained EfficientNet-CNN, and (iii) a hybrid approach combining (i) and (ii). RESULTS: In total, 2734 lymph nodes [555 (20.3%) PET-positive] from 100 patients [49% female; mean age 65, SD: 14] with lung cancer (60% adenocarcinoma, 21% plate epithelial carcinoma, 8% small-cell lung cancer) were included in this study. The area under the receiver operating characteristic curve (AUC) ranged from 0.79 to 0.87, and the scaled Brier score (SBS) ranged from 16 to 36%. The random forest model (iii) yielded the best results [AUC 0.871 (0.865-0.878), SBS 35.8 (34.2-37.2)] and had significantly higher model performance than both approaches alone (AUC: p < 0.001, z = 8.8 and z = 22.4; SBS: p < 0.001, z = 11.4 and z = 26.6, against (i) and (ii), respectively). CONCLUSION: Both traditional radiomics features and transfer-learning deep radiomics features provide relevant and complementary information for non-invasive N-staging in lung cancer.

Denoising diffusion probabilistic models for 3D medical image generation.

Recent advances in computer vision have shown promising results in image generation. Diffusion probabilistic models have generated realistic images from textual input, as demonstrated by DALL-E 2, Imagen, and Stable Diffusion. However, their use in medicine, where imaging data typically comprises three-dimensional volumes, has not been systematically evaluated. Synthetic images may play a crucial role in privacy-preserving artificial intelligence and can also be used to augment small datasets. We show that diffusion probabilistic models can synthesize high-quality medical data for magnetic resonance imaging (MRI) and computed tomography (CT). For quantitative evaluation, two radiologists rated the quality of the synthesized images regarding "realistic image appearance", "anatomical correctness", and "consistency between slices". Furthermore, we demonstrate that synthetic images can be used in self-supervised pre-training and improve the performance of breast segmentation models when data is scarce (Dice scores, 0.91 [without synthetic data], 0.95 [with synthetic data]).

European Association of Nuclear Medicine (EANM) Focus 4 consensus recommendations: molecular imaging and therapy in haematological tumours.

Given the paucity of high-certainty evidence, and differences in opinion on the use of nuclear medicine for hematological malignancies, we embarked on a consensus process involving key experts in this area. We aimed to assess consensus within a panel of experts on issues related to patient eligibility, imaging techniques, staging and response assessment, follow-up, and treatment decision-making, and to provide interim guidance by our expert consensus. We used a three-stage consensus process. First, we systematically reviewed and appraised the quality of existing evidence. Second, we generated a list of 153 statements based on the literature review to be agreed or disagreed with, with an additional statement added after the first round. Third, the 154 statements were scored by a panel of 26 experts purposively sampled from authors of published research on haematological tumours on a 1 (strongly disagree) to 9 (strongly agree) Likert scale in a two-round electronic Delphi review. The RAND and University of California Los Angeles appropriateness method was used for analysis. Between one and 14 systematic reviews were identified on each topic. All were rated as low to moderate quality. After two rounds of voting, there was consensus on 139 (90%) of 154 of the statements. There was consensus on most statements concerning the use of PET in non-Hodgkin and Hodgkin lymphoma. In multiple myeloma, more studies are required to define the optimal sequence for treatment assessment. Furthermore, nuclear medicine physicians and haematologists are awaiting consistent literature to introduce volumetric parameters, artificial intelligence, machine learning, and radiomics into routine practice.

CheckList for EvaluAtion of Radiomics research (CLEAR): a step-by-step reporting guideline for authors and reviewers endorsed by ESR and EuSoMII.

Even though radiomics can hold great potential for supporting clinical decision-making, its current use is mostly limited to academic research, without applications in routine clinical practice. The workflow of radiomics is complex due to several methodological steps and nuances, which often leads to inadequate reporting and evaluation, and poor reproducibility. Available reporting guidelines and checklists for artificial intelligence and predictive modeling include relevant good practices, but they are not tailored to radiomic research. There is a clear need for a complete radiomics checklist for study planning, manuscript writing, and evaluation during the review process to facilitate the repeatability and reproducibility of studies. We here present a documentation standard for radiomic research that can guide authors and reviewers. Our motivation is to improve the quality and reliability and, in turn, the reproducibility of radiomic research. We name the checklist CLEAR (CheckList for EvaluAtion of Radiomics research), to convey the idea of being more transparent. With its 58 items, the CLEAR checklist should be considered a standardization tool providing the minimum requirements for presenting clinical radiomics research. In addition to a dynamic online version of the checklist, a public repository has also been set up to allow the radiomics community to comment on the checklist items and adapt the checklist for future versions. Prepared and revised by an international group of experts using a modified Delphi method, we hope the CLEAR checklist will serve well as a single and complete scientific documentation tool for authors and reviewers to improve the radiomics literature.

Automation Bias in Mammography: The Impact of Artificial Intelligence BI-RADS Suggestions on Reader Performance.

Background Automation bias (the propensity for humans to favor suggestions from automated decision-making systems) is a known source of error in human-machine interactions, but its implications regarding artificial intelligence (AI)-aided mammography reading are unknown. Purpose To determine how automation bias can affect inexperienced, moderately experienced, and very experienced radiologists when reading mammograms with the aid of an artificial intelligence (AI) system. Materials and Methods In this prospective experiment, 27 radiologists read 50 mammograms and provided their Breast Imaging Reporting and Data System (BI-RADS) assessment assisted by a purported AI system. Mammograms were obtained between January 2017 and December 2019 and were presented in two randomized sets. The first was a training set of 10 mammograms, with the correct BI-RADS category suggested by the AI system. The second was a set of 40 mammograms in which an incorrect BI-RADS category was suggested for 12 mammograms. Reader performance, degree of bias in BI-RADS scoring, perceived accuracy of the AI system, and reader confidence in their own BI-RADS ratings were assessed using analysis of variance (ANOVA) and repeated-measures ANOVA followed by post hoc tests and Kruskal-Wallis tests followed by the Dunn post hoc test. Results The percentage of correctly rated mammograms by inexperienced (mean, 79.7% ± 11.7 [SD] vs 19.8% ± 14.0; P < .001; r = 0.93), moderately experienced (mean, 81.3% ± 10.1 vs 24.8% ± 11.6; P < .001; r = 0.96), and very experienced (mean, 82.3% ± 4.2 vs 45.5% ± 9.1; P = .003; r = 0.97) radiologists was significantly impacted by the correctness of the AI prediction of BI-RADS category. Inexperienced radiologists were significantly more likely to follow the suggestions of the purported AI when it incorrectly suggested a higher BI-RADS category than the actual ground truth compared with both moderately (mean degree of bias, 4.0 ± 1.8 vs 2.4 ± 1.5; P = .044; r = 0.46) and very (mean degree of bias, 4.0 ± 1.8 vs 1.2 ± 0.8; P = .009; r = 0.65) experienced readers. Conclusion The results show that inexperienced, moderately experienced, and very experienced radiologists reading mammograms are prone to automation bias when being supported by an AI-based system. This and other effects of human and machine interaction must be considered to ensure safe deployment and accurate diagnostic performance when combining human readers and AI. © RSNA, 2023 Supplemental material is available for this article. See also the editorial by Baltzer in this issue.

Clinical audit in European radiology: current status and recommendations for improvement endorsed by the European Society of Radiology (ESR).

Clinical audit is an important quality improvement activity and has significant benefits for patients in terms of enhanced care, safety, experience and outcomes. Clinical audit in support of radiation protection is mandated within the European Council Basic Safety Standards Directive (BSSD), 2013/59/Euratom. The European Society of Radiology (ESR) has recognised clinical audit as an area of particular importance in the delivery of safe and effective health care. The ESR, alongside other European organisations and professional bodies, has developed a range of clinical audit-related initiatives to support European radiology departments in developing a clinical audit infrastructure and fulfilling their legal obligations. However, work by the European Commission, the ESR and other agencies has demonstrated a persisting variability in clinical audit uptake and implementation across Europe and a lack of awareness of the BSSD clinical audit requirements. In recognition of these findings, the European Commission supported the QuADRANT project, led by the ESR and in partnership with ESTRO (European Association of Radiotherapy and Oncology) and EANM (European Association of Nuclear Medicine). QuADRANT was a 30-month project which completed in Summer 2022, aiming to provide an overview of the status of European clinical audit and identifying barriers and challenges to clinical audit uptake and implementation. This paper summarises the current position of European radiological clinical audit and considers the barriers and challenges that exist. Reference is made to the QuADRANT project, and a range of potential solutions are suggested to enhance radiological clinical audit across Europe.

Artificial intelligence in coronary computed tomography angiography: Demands and solutions from a clinical perspective.

Coronary computed tomography angiography (CCTA) is increasingly the cornerstone in the management of patients with chronic coronary syndromes. This fact is reflected by current guidelines, which show a fundamental shift towards non-invasive imaging - especially CCTA. The guidelines for acute and stable coronary artery disease (CAD) of the European Society of Cardiology from 2019 and 2020 emphasize this shift. However, to fulfill this new role, a broader availability in adjunct with increased robustness of data acquisition and speed of data reporting of CCTA is needed. Artificial intelligence (AI) has made enormous progress for all imaging methodologies concerning (semi)-automatic tools for data acquisition and data post-processing, with outreach toward decision support systems. Besides onco- and neuroimaging, cardiac imaging is one of the main areas of application. Most current AI developments in the scenario of cardiac imaging are related to data postprocessing. However, AI applications (including radiomics) for CCTA also should enclose data acquisition (especially the fact of dose reduction) and data interpretation (presence and extent of CAD). The main effort will be to integrate these AI-driven processes into the clinical workflow, and to combine imaging data/results with further clinical data, thus - beyond the diagnosis of CAD- enabling prediction and forecast of morbidity and mortality. Furthermore, data fusing for therapy planning (e.g., invasive angiography/TAVI planning) will be warranted. The aim of this review is to present a holistic overview of AI applications in CCTA (including radiomics) under the umbrella of clinical workflows and clinical decision-making. The review first summarizes and analyzes applications for the main role of CCTA, i.e., to non-invasively rule out stable coronary artery disease. In the second step, AI applications for additional diagnostic purposes, i.e., to improve diagnostic power (CAC = coronary artery classifications), improve differential diagnosis (CT-FFR and CT perfusion), and finally improve prognosis (again CAC plus epi- and pericardial fat analysis) are reviewed.

An overview and a roadmap for artificial intelligence in hematology and oncology.

BACKGROUND: Artificial intelligence (AI) is influencing our society on many levels and has broad implications for the future practice of hematology and oncology. However, for many medical professionals and researchers, it often remains unclear what AI can and cannot do, and what are promising areas for a sensible application of AI in hematology and oncology. Finally, the limits and perils of using AI in oncology are not obvious to many healthcare professionals. METHODS: In this article, we provide an expert-based consensus statement by the joint Working Group on "Artificial Intelligence in Hematology and Oncology" by the German Society of Hematology and Oncology (DGHO), the German Association for Medical Informatics, Biometry and Epidemiology (GMDS), and the Special Interest Group Digital Health of the German Informatics Society (GI). We provide a conceptual framework for AI in hematology and oncology. RESULTS: First, we propose a technological definition, which we deliberately set in a narrow frame to mainly include the technical developments of the last ten years. Second, we present a taxonomy of clinically relevant AI systems, structured according to the type of clinical data they are used to analyze. Third, we show an overview of potential applications, including clinical, research, and educational environments with a focus on hematology and oncology. CONCLUSION: Thus, this article provides a point of reference for hematologists and oncologists, and at the same time sets forth a framework for the further development and clinical deployment of AI in hematology and oncology in the future.

Structured Reporting in Cross-Sectional Imaging of the Heart: Reporting Templates for CMR Imaging of Ischemia and Myocardial Viability and for Cardiac CT Imaging of Coronary Heart Disease and TAVI Planning. / Strukturierte Befundung in der Schnittbilddiagnostik des Herzens: Befundvorlagen für die Herz-MRT bezüglich Ischämie- und Vitalitätsdiagnostik sowie für die Herz-CT bezüglich Koronardiagnostik und Planung vor TAVI.

BACKGROUND: Structured reporting allows a high grade of standardization and thus a safe and unequivocal report communication. In the past years, the radiological societies have started several initiatives to base radiological reports on structured reporting rather than free text reporting. METHODS: Upon invitation of the working group for Cardiovascular Imaging of the German Society of Radiology, in 2018 an interdisciplinary group of Radiologists, Cardiologists, Pediatric Cardiologists and Cardiothoracic surgeons -all experts on the field of cardiovascular MR and CT imaging- met for interdisciplinary consensus meetings at the University Hospital Cologne. The aim of these meetings was to develop and consent templates for structured reporting in cardiac MR and CT of various cardiovascular diseases. RESULTS: Two templates for structured reporting of CMR in ischemia imaging and vitality imaging and two templates for structured reporting of CT imaging for planning Transcatheter Aortic Valve Implantation (TAVI; pre-TAVI-CT) and coronary CT were discussed, consented and transferred to a HTML 5/IHR MRRT compatible format. The templates were made available for free use on the website www.befundung.drg.de. CONCLUSION: This paper suggests consented templates in German language for the structured reporting of cross-sectional CMR imaging of ischemia and vitality as well as reporting of CT imaging pre-TAVI and coronary CT. The implementation of these templates is aimed at providing a constant level of high reporting quality and increasing the efficiency of report generation as well as a clinically based communication of imaging results. KEY POINTS: · Structured reporting offers a constant level of high reporting quality and increases the efficiency of report generation as well as a clinically based communication of imaging results.. · For the first time templates in German language for the structured reporting of CMR imaging of ischemia and vitality and CT imaging pre-TAVI and coronary CT are reported.. · These templates will be made available on the website www.befundung.drg.de and can be commented via strukturierte-befundung@drg.de.. ZITIERWEISE: · Soschynski M, Bunck AC, Beer M et al. Structured Reporting in Cross-Sectional Imaging of the Heart: Reporting Templates for CMR Imaging of Ischemia and Myocardial Viability and for Cardiac CT Imaging of Coronary Heart Disease and TAVI Planning. Fortschr Röntgenstr 2023; 195: 293 - 296.

Influence of Image Processing on Radiomic Features From Magnetic Resonance Imaging.

OBJECTIVE: Before implementing radiomics in routine clinical practice, comprehensive knowledge about the repeatability and reproducibility of radiomic features is required. The aim of this study was to systematically investigate the influence of image processing parameters on radiomic features from magnetic resonance imaging (MRI) in terms of feature values as well as test-retest repeatability. MATERIALS AND METHODS: Utilizing a phantom consisting of 4 onions, 4 limes, 4 kiwifruits, and 4 apples, we acquired a test-retest dataset featuring 3 of the most commonly used MRI sequences on a 3 T scanner, namely, a T1-weighted, a T2-weighted, and a fluid-attenuated inversion recovery sequence, each at high and low resolution. After semiautomatic image segmentation, image processing with systematic variation of image processing parameters was performed, including spatial resampling, intensity discretization, and intensity rescaling. For each respective image processing setting, a total of 45 radiomic features were extracted, corresponding to the following 7 matrices/feature classes: conventional indices, histogram matrix, shape matrix, gray-level zone length matrix, gray-level run length matrix, neighboring gray-level dependence matrix, and gray-level cooccurrence matrix. Systematic differences of individual features between different resampling steps were assessed using 1-way analysis of variance with Tukey-type post hoc comparisons to adjust for multiple testing. Test-retest repeatability of radiomic features was measured using the concordance correlation coefficient, dynamic range, and intraclass correlation coefficient. RESULTS: Image processing influenced radiological feature values. Regardless of the acquired sequence and feature class, significant differences ( P < 0.05) in feature values were found when the size of the resampled voxels was too large, that is, bigger than 3 mm. Almost all higher-order features depended strongly on intensity discretization. The effects of intensity rescaling were negligible except for some features derived from T1-weighted sequences. For all sequences, the percentage of repeatable features (concordance correlation coefficient and dynamic range ≥ 0.9) varied considerably depending on the image processing settings. The optimal image processing setting to achieve the highest percentage of stable features varied per sequence. Irrespective of image processing, the fluid-attenuated inversion recovery sequence in high-resolution overall yielded the highest number of stable features in comparison with the other sequences (89% vs 64%-78% for the respective optimal image processing settings). Across all sequences, the most repeatable features were generally obtained for a spatial resampling close to the originally acquired voxel size and an intensity discretization to at least 32 bins. CONCLUSION: Variation of image processing parameters has a significant impact on the values of radiomic features as well as their repeatability. Furthermore, the optimal image processing parameters differ for each MRI sequence. Therefore, it is recommended that these processing parameters be determined in corresponding test-retest scans before clinical application. Extensive repeatability, reproducibility, and validation studies as well as standardization are required before quantitative image analysis and radiomics can be reliably translated into routine clinical care.

Semi-automated volumetry of pulmonary nodules: Intra-individual comparison of standard dose and chest X-ray equivalent ultralow dose chest CT scans.

PURPOSE: To assess the performance of semi-automated volumetry of solid pulmonary nodules on single-energy tin-filtered ultralow dose (ULD) chest CT scans at a radiation dose equivalent to chest X-ray relative to standard dose (SD) chest CT scans and assess the impact of kernel and iterative reconstruction selection. METHODS: Ninety-four consecutive patients from a prospective single-center study were included and underwent clinically indicated SD chest CT (1.9 ± 0.8 mSv) and additional ULD chest CT (0.13 ± 0.01 mSv) in the same session. All scans were reconstructed with a soft tissue (Br40) and lung (Bl64) kernel as well as with Filtered Back Projection (FBP) and Iterative Reconstruction (ADMIRE-3 and ADMIRE-5). One hundred and forty-eight solid pulmonary nodules were identified and analysed by semi-automated volumetry on all reconstructions. Nodule volumes were compared amongst all reconstructions thereby focusing on the agreement between SD and ULD scans. RESULTS: Nodule volumes ranged from 58.5 (28.8-126) mm3 for ADMIRE-5 Br40 ULD reconstructions to 72.5 (39-134) mm3 for FBP Bl64 SD reconstructions with significant differences between reconstructions (p < 0.001). Interscan agreement of volumes between two given reconstructions ranged from ICC = 0.605 to ICC = 0.999. Between SD and ULD scans, agreement of nodule volumes was highest for FBP Br40 (ICC = 0.995), FBP Bl64 (ICC = 0.939) and ADMIRE-5 Bl64 (ICC = 0.994) reconstructions. ADMIRE-3 reconstructions exhibited reduced interscan agreement of nodule volumes (ICCs from 0.788 - 0.882). CONCLUSIONS: The interscan agreement of node volumes between SD and ULD is high depending on the choice of kernel and reconstruction algorithm. However, caution should be exercised when comparing two image series that were not identically reconstructed.