Perfect Match: Radiomics and Artificial Intelligence in Cardiac Imaging.

Cardiovascular diseases remain a significant health burden, with imaging modalities like echocardiography, cardiac computed tomography, and cardiac magnetic resonance imaging playing a crucial role in diagnosis and prognosis. However, the inherent heterogeneity of these diseases poses challenges, necessitating advanced analytical methods like radiomics and artificial intelligence. Radiomics extracts quantitative features from medical images, capturing intricate patterns and subtle variations that may elude visual inspection. Artificial intelligence techniques, including deep learning, can analyze these features to generate knowledge, define novel imaging biomarkers, and support diagnostic decision-making and outcome prediction. Radiomics and artificial intelligence thus hold promise for significantly enhancing diagnostic and prognostic capabilities in cardiac imaging, paving the way for more personalized and effective patient care. This review explores the synergies between radiomics and artificial intelligence in cardiac imaging, following the radiomics workflow and introducing concepts from both domains. Potential clinical applications, challenges, and limitations are discussed, along with solutions to overcome them.

Radiomics workflow definition & challenges - German priority program 2177 consensus statement on clinically applied radiomics.

OBJECTIVES: Achieving a consensus on a definition for different aspects of radiomics workflows to support their translation into clinical usage. Furthermore, to assess the perspective of experts on important challenges for a successful clinical workflow implementation. MATERIALS AND METHODS: The consensus was achieved by a multi-stage process. Stage 1 comprised a definition screening, a retrospective analysis with semantic mapping of terms found in 22 workflow definitions, and the compilation of an initial baseline definition. Stages 2 and 3 consisted of a Delphi process with over 45 experts hailing from sites participating in the German Research Foundation (DFG) Priority Program 2177. Stage 2 aimed to achieve a broad consensus for a definition proposal, while stage 3 identified the importance of translational challenges. RESULTS: Workflow definitions from 22 publications (published 2012-2020) were analyzed. Sixty-nine definition terms were extracted, mapped, and semantic ambiguities (e.g., homonymous and synonymous terms) were identified and resolved. The consensus definition was developed via a Delphi process. The final definition comprising seven phases and 37 aspects reached a high overall consensus (> 89% of experts "agree" or "strongly agree"). Two aspects reached no strong consensus. In addition, the Delphi process identified and characterized from the participating experts' perspective the ten most important challenges in radiomics workflows. CONCLUSION: To overcome semantic inconsistencies between existing definitions and offer a well-defined, broad, referenceable terminology, a consensus workflow definition for radiomics-based setups and a terms mapping to existing literature was compiled. Moreover, the most relevant challenges towards clinical application were characterized. CRITICAL RELEVANCE STATEMENT: Lack of standardization represents one major obstacle to successful clinical translation of radiomics. Here, we report a consensus workflow definition on different aspects of radiomics studies and highlight important challenges to advance the clinical adoption of radiomics. KEY POINTS: Published radiomics workflow terminologies are inconsistent, hindering standardization and translation. A consensus radiomics workflow definition proposal with high agreement was developed. Publicly available result resources for further exploitation by the scientific community.

Cooperative AI training for cardiothoracic segmentation in computed tomography: An iterative multi-center annotation approach.

PURPOSE: Radiological reporting is transitioning to quantitative analysis, requiring large-scale multi-center validation of biomarkers. A major prerequisite and bottleneck for this task is the voxelwise annotation of image data, which is time-consuming for large cohorts. In this study, we propose an iterative training workflow to support and facilitate such segmentation tasks, specifically for high-resolution thoracic CT data. METHODS: Our study included 132 thoracic CT scans from clinical practice, annotated by 13 radiologists. In three iterative training experiments, we aimed to improve and accelerate segmentation of the heart and mediastinum. Each experiment started with manual segmentation of 5-25 CT scans, which served as training data for a nnU-Net. Further iterations incorporated AI pre-segmentation and human correction to improve accuracy, accelerate the annotation process, and reduce human involvement over time. RESULTS: Results showed consistent improvement in AI model quality with each iteration. Resampled datasets improved the Dice similarity coefficients for both the heart (DCS 0.91 [0.88; 0.92]) and the mediastinum (DCS 0.95 [0.94; 0.95]). Our AI models reduced human interaction time by 50 % for heart and 70 % for mediastinum segmentation in the most potent iteration. A model trained on only five datasets achieved satisfactory results (DCS > 0.90). CONCLUSIONS: The iterative training workflow provides an efficient method for training AI-based segmentation models in multi-center studies, improving accuracy over time and simultaneously reducing human intervention. Future work will explore the use of fewer initial datasets and additional pre-processing methods to enhance model quality.

Robustness of radiomic features in healthy abdominal parenchyma of patients with repeated examinations on dual-layer dual-energy CT.

OBJECTIVES: Robustness of radiomic features in physiological tissue is an important prerequisite for quantitative analysis of tumor biology and response assessment. In contrast to previous studies which focused on different tumors with mostly short scan-re-scan intervals, this study aimed to evaluate the robustness of radiomic features in cancer-free patients and over a clinically encountered inter-scan interval. MATERIALS AND METHODS: Patients without visible tumor burden who underwent at least two portal-venous phase dual energy CT examinations of the abdomen between May 2016 and January 2020 were included, while macroscopic tumor burden was excluded based upon follow-up imaging for all patients (≥3 months). Further, patients were excluded if no follow-up imaging was available, or if the CT protocol showed deviations between repeated examinations. Circular regions of interest were placed and proofread by two board-certified radiologists (4 years and 5 years experience) within the liver (segments 3 and 6), the psoas muscle (left and right), the pancreatic head, and the spleen to obtain radiomic features from normal-appearing organ parenchyma using PyRadiomics. Radiomic feature robustness was tested using the concordance correlation coefficient with a threshold of 0.75 considered indicative for deeming a feature robust. RESULTS: In total, 160 patients with 480 repeated abdominal CT examinations (range: 2-4 per patient) were retrospectively included in this single-center, IRB-approved study. Considering all organs and feature categories, only 4.58 % (25/546) of all features were robust with the highest rate being found in the first order feature category (20.37 %, 22/108). Other feature categories (grey level co-occurrence matrix, grey level dependence matrix, grey level run length matrix, grey level size zone matrix, and neighborhood gray-tone difference matrix) yielded an overall low percentage of robust features (range: 0.00 %-1.19 %). A subgroup analysis revealed the reconstructed field of view and the X-ray tube current as determinants of feature robustness (significant differences in subgroups for all organs, p < 0.001) as well as the size of the region of interest (no significant difference for the pancreatic head with p = 0.135, significant difference with p < 0.001 for all other organs). CONCLUSION: Radiomic feature robustness obtained from cancer-free subjects with repeated examinations using a consistent protocol and CT scanner was limited, with first order features yielding the highest proportion of robust features.

Native myocardial T1 mapping: influence of spatial resolution on quantitative results and reproducibility.

Background: Myocardial mapping techniques can be used to quantitatively assess alterations in myocardial tissue properties. This study aims to evaluate the influence of spatial resolution on quantitative results and reproducibility of native myocardial T1 mapping in cardiac magnetic resonance imaging (MRI). Methods: In this cross-sectional study with prospective data collection between October 2019 and February 2020, 50 healthy adults underwent two identical cardiac MRI examinations in the radiology department on the same day. T1 mapping was performed using a MOLLI 5(3)3 sequence with higher (1.4 mm × 1.4 mm) and lower (1.9 mm × 1.9 mm) in-plane spatial resolution. Global quantitative results of T1 mapping were compared between high-resolution and low-resolution acquisitions using paired t-test. Intra-class correlation coefficient (ICC) and Bland-Altman statistics (absolute and percentage differences as means ± SD) were used for assessing test-retest reproducibility. Results: There was no significant difference between global quantitative results acquired with high vs. low-resolution T1 mapping. The reproducibility of global T1 values was good for high-resolution (ICC: 0.88) and excellent for low-resolution T1 mapping (ICC: 0.95, P=0.003). In subgroup analyses, inferior test-retest reproducibility was observed for high spatial resolution in women compared to low spatial resolution (ICC: 0.71 vs. 0.91, P=0.001) and heart rates >77 bpm (ICC: 0.53 vs. 0.88, P=0.004). Apical segments had higher T1 values and variability compared to other segments. Regional T1 values for basal (ICC: 0.81 vs. 0.89, P=0.023) and apical slices (ICC: 0.86 vs. 0.92, P=0.024) showed significantly higher reproducibility in low-resolution compared to high-resolution acquisitions but without differences for midventricular slice (ICC: 0.91 vs. 0.92, P=0.402). Conclusions: Based on our data, we recommend a spatial resolution on the order of 1.9 mm × 1.9 mm for native myocardial T1 mapping using a MOLLI 5(3)3 sequence at 1.5 T particularly in individuals with higher heart rates and women.

METhodological RadiomICs Score (METRICS): a quality scoring tool for radiomics research endorsed by EuSoMII.

PURPOSE: To propose a new quality scoring tool, METhodological RadiomICs Score (METRICS), to assess and improve research quality of radiomics studies. METHODS: We conducted an online modified Delphi study with a group of international experts. It was performed in three consecutive stages: Stage#1, item preparation; Stage#2, panel discussion among EuSoMII Auditing Group members to identify the items to be voted; and Stage#3, four rounds of the modified Delphi exercise by panelists to determine the items eligible for the METRICS and their weights. The consensus threshold was 75%. Based on the median ranks derived from expert panel opinion and their rank-sum based conversion to importance scores, the category and item weights were calculated. RESULT: In total, 59 panelists from 19 countries participated in selection and ranking of the items and categories. Final METRICS tool included 30 items within 9 categories. According to their weights, the categories were in descending order of importance: study design, imaging data, image processing and feature extraction, metrics and comparison, testing, feature processing, preparation for modeling, segmentation, and open science. A web application and a repository were developed to streamline the calculation of the METRICS score and to collect feedback from the radiomics community. CONCLUSION: In this work, we developed a scoring tool for assessing the methodological quality of the radiomics research, with a large international panel and a modified Delphi protocol. With its conditional format to cover methodological variations, it provides a well-constructed framework for the key methodological concepts to assess the quality of radiomic research papers. CRITICAL RELEVANCE STATEMENT: A quality assessment tool, METhodological RadiomICs Score (METRICS), is made available by a large group of international domain experts, with transparent methodology, aiming at evaluating and improving research quality in radiomics and machine learning. KEY POINTS: • A methodological scoring tool, METRICS, was developed for assessing the quality of radiomics research, with a large international expert panel and a modified Delphi protocol. • The proposed scoring tool presents expert opinion-based importance weights of categories and items with a transparent methodology for the first time. • METRICS accounts for varying use cases, from handcrafted radiomics to entirely deep learning-based pipelines. • A web application has been developed to help with the calculation of the METRICS score ( https://metricsscore.github.io/metrics/METRICS.html ) and a repository created to collect feedback from the radiomics community ( https://github.com/metricsscore/metrics ).

Towards reproducible radiomics research: introduction of a database for radiomics studies.

OBJECTIVES: To investigate the model-, code-, and data-sharing practices in the current radiomics research landscape and to introduce a radiomics research database. METHODS: A total of 1254 articles published between January 1, 2021, and December 31, 2022, in leading radiology journals (European Radiology, European Journal of Radiology, Radiology, Radiology: Artificial Intelligence, Radiology: Cardiothoracic Imaging, Radiology: Imaging Cancer) were retrospectively screened, and 257 original research articles were included in this study. The categorical variables were compared using Fisher's exact tests or chi-square test and numerical variables using Student's t test with relation to the year of publication. RESULTS: Half of the articles (128 of 257) shared the model by either including the final model formula or reporting the coefficients of selected radiomics features. A total of 73 (28%) models were validated on an external independent dataset. Only 16 (6%) articles shared the data or used publicly available open datasets. Similarly, only 20 (7%) of the articles shared the code. A total of 7 (3%) articles both shared code and data. All collected data in this study is presented in a radiomics research database (RadBase) and could be accessed at https://github.com/EuSoMII/RadBase . CONCLUSION: According to the results of this study, the majority of published radiomics models were not technically reproducible since they shared neither model nor code and data. There is still room for improvement in carrying out reproducible and open research in the field of radiomics. CLINICAL RELEVANCE STATEMENT: To date, the reproducibility of radiomics research and open science practices within the radiomics research community are still very low. Ensuring reproducible radiomics research with model-, code-, and data-sharing practices will facilitate faster clinical translation. KEY POINTS: • There is a discrepancy between the number of published radiomics papers and the clinical implementation of these published radiomics models. • The main obstacle to clinical implementation is the lack of model-, code-, and data-sharing practices. • In order to translate radiomics research into clinical practice, the radiomics research community should adopt open science practices.

The challenges of research data management in cardiovascular science: a DGK and DZHK position paper-executive summary.

The sharing and documentation of cardiovascular research data are essential for efficient use and reuse of data, thereby aiding scientific transparency, accelerating the progress of cardiovascular research and healthcare, and contributing to the reproducibility of research results. However, challenges remain. This position paper, written on behalf of and approved by the German Cardiac Society and German Centre for Cardiovascular Research, summarizes our current understanding of the challenges in cardiovascular research data management (RDM). These challenges include lack of time, awareness, incentives, and funding for implementing effective RDM; lack of standardization in RDM processes; a need to better identify meaningful and actionable data among the increasing volume and complexity of data being acquired; and a lack of understanding of the legal aspects of data sharing. While several tools exist to increase the degree to which data are findable, accessible, interoperable, and reusable (FAIR), more work is needed to lower the threshold for effective RDM not just in cardiovascular research but in all biomedical research, with data sharing and reuse being factored in at every stage of the scientific process. A culture of open science with FAIR research data should be fostered through education and training of early-career and established research professionals. Ultimately, FAIR RDM requires permanent, long-term effort at all levels. If outcomes can be shown to be superior and to promote better (and better value) science, modern RDM will make a positive difference to cardiovascular science and practice. The full position paper is available in the supplementary materials.

Addressing challenges in radiomics research: systematic review and repository of open-access cancer imaging datasets.

OBJECTIVES: Open-access cancer imaging datasets have become integral for evaluating novel AI approaches in radiology. However, their use in quantitative analysis with radiomics features presents unique challenges, such as incomplete documentation, low visibility, non-uniform data formats, data inhomogeneity, and complex preprocessing. These issues may cause problems with reproducibility and standardization in radiomics studies. METHODS: We systematically reviewed imaging datasets with public copyright licenses, published up to March 2023 across four large online cancer imaging archives. We included only datasets with tomographic images (CT, MRI, or PET), segmentations, and clinical annotations, specifically identifying those suitable for radiomics research. Reproducible preprocessing and feature extraction were performed for each dataset to enable their easy reuse. RESULTS: We discovered 29 datasets with corresponding segmentations and labels in the form of health outcomes, tumor pathology, staging, imaging-based scores, genetic markers, or repeated imaging. We compiled a repository encompassing 10,354 patients and 49,515 scans. Of the 29 datasets, 15 were licensed under Creative Commons licenses, allowing both non-commercial and commercial usage and redistribution, while others featured custom or restricted licenses. Studies spanned from the early 1990s to 2021, with the majority concluding after 2013. Seven different formats were used for the imaging data. Preprocessing and feature extraction were successfully performed for each dataset. CONCLUSION: RadiomicsHub is a comprehensive public repository with radiomics features derived from a systematic review of public cancer imaging datasets. By converting all datasets to a standardized format and ensuring reproducible and traceable processing, RadiomicsHub addresses key reproducibility and standardization challenges in radiomics. CRITICAL RELEVANCE STATEMENT: This study critically addresses the challenges associated with locating, preprocessing, and extracting quantitative features from open-access datasets, to facilitate more robust and reliable evaluations of radiomics models. KEY POINTS: - Through a systematic review, we identified 29 cancer imaging datasets suitable for radiomics research. - A public repository with collection overview and radiomics features, encompassing 10,354 patients and 49,515 scans, was compiled. - Most datasets can be shared, used, and built upon freely under a Creative Commons license. - All 29 identified datasets have been converted into a common format to enable reproducible radiomics feature extraction.

Deep Learning k-Space-to-Image Reconstruction Facilitates High Spatial Resolution and Scan Time Reduction in Diffusion-Weighted Imaging Breast MRI.

BACKGROUND: For time-consuming diffusion-weighted imaging (DWI) of the breast, deep learning-based imaging acceleration appears particularly promising. PURPOSE: To investigate a combined k-space-to-image reconstruction approach for scan time reduction and improved spatial resolution in breast DWI. STUDY TYPE: Retrospective. POPULATION: 133 women (age 49.7 ± 12.1 years) underwent multiparametric breast MRI. FIELD STRENGTH/SEQUENCE: 3.0T/T2 turbo spin echo, T1 3D gradient echo, DWI (800 and 1600 sec/mm2 ). ASSESSMENT: DWI data were retrospectively processed using deep learning-based k-space-to-image reconstruction (DL-DWI) and an additional super-resolution algorithm (SRDL-DWI). In addition to signal-to-noise ratio and apparent diffusion coefficient (ADC) comparisons among standard, DL- and SRDL-DWI, a range of quantitative similarity (e.g., structural similarity index [SSIM]) and error metrics (e.g., normalized root mean square error [NRMSE], symmetric mean absolute percent error [SMAPE], log accuracy error [LOGAC]) was calculated to analyze structural variations. Subjective image evaluation was performed independently by three radiologists on a seven-point rating scale. STATISTICAL TESTS: Friedman's rank-based analysis of variance with Bonferroni-corrected pairwise post-hoc tests. P < 0.05 was considered significant. RESULTS: Both DL- and SRDL-DWI allowed for a 39% reduction in simulated scan time over standard DWI (5 vs. 3 minutes). The highest image quality ratings were assigned to SRDL-DWI with good interreader agreement (ICC 0.834; 95% confidence interval 0.818-0.848). Irrespective of b-value, both standard and DL-DWI produced superior SNR compared to SRDL-DWI. ADC values were slightly higher in SRDL-DWI (+0.5%) and DL-DWI (+3.4%) than in standard DWI. Structural similarity was excellent between DL-/SRDL-DWI and standard DWI for either b value (SSIM ≥ 0.86). Calculation of error metrics (NRMSE ≤ 0.05, SMAPE ≤ 0.02, and LOGAC ≤ 0.04) supported the assumption of low voxel-wise error. DATA CONCLUSION: Deep learning-based k-space-to-image reconstruction reduces simulated scan time of breast DWI by 39% without influencing structural similarity. Additionally, super-resolution interpolation allows for substantial improvement of subjective image quality. EVIDENCE LEVEL: 4 TECHNICAL EFFICACY: Stage 1.

Automated localization and segmentation of cervical lymph nodes on contrast-enhanced CT using a 3D foveal fully convolutional neural network.

BACKGROUND: In the management of cancer patients, determination of TNM status is essential for treatment decision-making and therefore closely linked to clinical outcome and survival. Here, we developed a tool for automatic three-dimensional (3D) localization and segmentation of cervical lymph nodes (LNs) on contrast-enhanced computed tomography (CECT) examinations. METHODS: In this IRB-approved retrospective single-center study, 187 CECT examinations of the head and neck region from patients with various primary diseases were collected from our local database, and 3656 LNs (19.5 ± 14.9 LNs/CECT, mean ± standard deviation) with a short-axis diameter (SAD) ≥ 5 mm were segmented manually by expert physicians. With these data, we trained an independent fully convolutional neural network based on 3D foveal patches. Testing was performed on 30 independent CECTs with 925 segmented LNs with an SAD ≥ 5 mm. RESULTS: In total, 4,581 LNs were segmented in 217 CECTs. The model achieved an average localization rate (LR), i.e., percentage of localized LNs/CECT, of 78.0% in the validation dataset. In the test dataset, average LR was 81.1% with a mean Dice coefficient of 0.71. For enlarged LNs with a SAD ≥ 10 mm, LR was 96.2%. In the test dataset, the false-positive rate was 2.4 LNs/CECT. CONCLUSIONS: Our trained AI model demonstrated a good overall performance in the consistent automatic localization and 3D segmentation of physiological and metastatic cervical LNs with a SAD ≥ 5 mm on CECTs. This could aid clinical localization and automatic 3D segmentation, which can benefit clinical care and radiomics research. RELEVANCE STATEMENT: Our AI model is a time-saving tool for 3D segmentation of cervical lymph nodes on contrast-enhanced CT scans and serves as a solid base for N staging in clinical practice and further radiomics research. KEY POINTS: • Determination of N status in TNM staging is essential for therapy planning in oncology. • Segmenting cervical lymph nodes manually is highly time-consuming in clinical practice. • Our model provides a robust, automated 3D segmentation of cervical lymph nodes. • It achieves a high accuracy for localization especially of enlarged lymph nodes. • These segmentations should assist clinical care and radiomics research.

Transfer-Learning Deep Radiomics and Hand-Crafted Radiomics for Classifying Lymph Nodes from Contrast-Enhanced Computed Tomography in Lung Cancer.

OBJECTIVES: Positron emission tomography (PET) is currently considered the non-invasive reference standard for lymph node (N-)staging in lung cancer. However, not all patients can undergo this diagnostic procedure due to high costs, limited availability, and additional radiation exposure. The purpose of this study was to predict the PET result from traditional contrast-enhanced computed tomography (CT) and to test different feature extraction strategies. METHODS: In this study, 100 lung cancer patients underwent a contrast-enhanced 18F-fluorodeoxyglucose (FDG) PET/CT scan between August 2012 and December 2019. We trained machine learning models to predict FDG uptake in the subsequent PET scan. Model inputs were composed of (i) traditional "hand-crafted" radiomics features from the segmented lymph nodes, (ii) deep features derived from a pretrained EfficientNet-CNN, and (iii) a hybrid approach combining (i) and (ii). RESULTS: In total, 2734 lymph nodes [555 (20.3%) PET-positive] from 100 patients [49% female; mean age 65, SD: 14] with lung cancer (60% adenocarcinoma, 21% plate epithelial carcinoma, 8% small-cell lung cancer) were included in this study. The area under the receiver operating characteristic curve (AUC) ranged from 0.79 to 0.87, and the scaled Brier score (SBS) ranged from 16 to 36%. The random forest model (iii) yielded the best results [AUC 0.871 (0.865-0.878), SBS 35.8 (34.2-37.2)] and had significantly higher model performance than both approaches alone (AUC: p < 0.001, z = 8.8 and z = 22.4; SBS: p < 0.001, z = 11.4 and z = 26.6, against (i) and (ii), respectively). CONCLUSION: Both traditional radiomics features and transfer-learning deep radiomics features provide relevant and complementary information for non-invasive N-staging in lung cancer.

Trends and statistics of artificial intelligence and radiomics research in Radiology, Nuclear Medicine, and Medical Imaging: bibliometric analysis.

OBJECTIVE: To conduct a comprehensive bibliometric analysis of artificial intelligence (AI) and its subfields as well as radiomics in Radiology, Nuclear Medicine, and Medical Imaging (RNMMI). METHODS: Web of Science was queried for relevant publications in RNMMI and medicine along with their associated data from 2000 to 2021. Bibliometric techniques utilised were co-occurrence, co-authorship, citation burst, and thematic evolution analyses. Growth rate and doubling time were also estimated using log-linear regression analyses. RESULTS: According to the number of publications, RNMMI (11,209; 19.8%) was the most prominent category in medicine (56,734). USA (44.6%) and China (23.1%) were the two most productive and collaborative countries. USA and Germany experienced the strongest citation bursts. Thematic evolution has recently exhibited a significant shift toward deep learning. In all analyses, the annual number of publications and citations demonstrated exponential growth, with deep learning-based publications exhibiting the most prominent growth pattern. Estimated continuous growth rate, annual growth rate, and doubling time of the AI and machine learning publications in RNMMI were 26.1% (95% confidence interval [CI], 12.0-40.2%), 29.8% (95% CI, 12.7-49.5%), and 2.7 years (95% CI, 1.7-5.8), respectively. In the sensitivity analysis using data from the last 5 and 10 years, these estimates ranged from 47.6 to 51.1%, 61.0 to 66.7%, and 1.4 to 1.5 years. CONCLUSION: This study provides an overview of AI and radiomics research conducted mainly in RNMMI. These results may assist researchers, practitioners, policymakers, and organisations in gaining a better understanding of both the evolution of these fields and the importance of supporting (e.g., financial) these research activities. KEY POINTS: • In terms of the number of publications on AI and ML, Radiology, Nuclear Medicine, and Medical Imaging was the most prominent category compared to the other categories related to medicine (e.g., Health Policy & Services, Surgery). • All evaluated analyses (i.e., AI, its subfields, and radiomics), based on the annual number of publications and citations, demonstrated exponential growth, with decreasing doubling time, which indicates increasing interest from researchers, journals, and, in turn, the medical imaging community. • The most prominent growth pattern was observed in deep learning-based publications. However, the further thematic analysis demonstrated that deep learning has been underdeveloped but highly relevant to the medical imaging community.

European Association of Nuclear Medicine (EANM) Focus 4 consensus recommendations: molecular imaging and therapy in haematological tumours.

Given the paucity of high-certainty evidence, and differences in opinion on the use of nuclear medicine for hematological malignancies, we embarked on a consensus process involving key experts in this area. We aimed to assess consensus within a panel of experts on issues related to patient eligibility, imaging techniques, staging and response assessment, follow-up, and treatment decision-making, and to provide interim guidance by our expert consensus. We used a three-stage consensus process. First, we systematically reviewed and appraised the quality of existing evidence. Second, we generated a list of 153 statements based on the literature review to be agreed or disagreed with, with an additional statement added after the first round. Third, the 154 statements were scored by a panel of 26 experts purposively sampled from authors of published research on haematological tumours on a 1 (strongly disagree) to 9 (strongly agree) Likert scale in a two-round electronic Delphi review. The RAND and University of California Los Angeles appropriateness method was used for analysis. Between one and 14 systematic reviews were identified on each topic. All were rated as low to moderate quality. After two rounds of voting, there was consensus on 139 (90%) of 154 of the statements. There was consensus on most statements concerning the use of PET in non-Hodgkin and Hodgkin lymphoma. In multiple myeloma, more studies are required to define the optimal sequence for treatment assessment. Furthermore, nuclear medicine physicians and haematologists are awaiting consistent literature to introduce volumetric parameters, artificial intelligence, machine learning, and radiomics into routine practice.

CheckList for EvaluAtion of Radiomics research (CLEAR): a step-by-step reporting guideline for authors and reviewers endorsed by ESR and EuSoMII.

Even though radiomics can hold great potential for supporting clinical decision-making, its current use is mostly limited to academic research, without applications in routine clinical practice. The workflow of radiomics is complex due to several methodological steps and nuances, which often leads to inadequate reporting and evaluation, and poor reproducibility. Available reporting guidelines and checklists for artificial intelligence and predictive modeling include relevant good practices, but they are not tailored to radiomic research. There is a clear need for a complete radiomics checklist for study planning, manuscript writing, and evaluation during the review process to facilitate the repeatability and reproducibility of studies. We here present a documentation standard for radiomic research that can guide authors and reviewers. Our motivation is to improve the quality and reliability and, in turn, the reproducibility of radiomic research. We name the checklist CLEAR (CheckList for EvaluAtion of Radiomics research), to convey the idea of being more transparent. With its 58 items, the CLEAR checklist should be considered a standardization tool providing the minimum requirements for presenting clinical radiomics research. In addition to a dynamic online version of the checklist, a public repository has also been set up to allow the radiomics community to comment on the checklist items and adapt the checklist for future versions. Prepared and revised by an international group of experts using a modified Delphi method, we hope the CLEAR checklist will serve well as a single and complete scientific documentation tool for authors and reviewers to improve the radiomics literature.

Denoising diffusion probabilistic models for 3D medical image generation.

Recent advances in computer vision have shown promising results in image generation. Diffusion probabilistic models have generated realistic images from textual input, as demonstrated by DALL-E 2, Imagen, and Stable Diffusion. However, their use in medicine, where imaging data typically comprises three-dimensional volumes, has not been systematically evaluated. Synthetic images may play a crucial role in privacy-preserving artificial intelligence and can also be used to augment small datasets. We show that diffusion probabilistic models can synthesize high-quality medical data for magnetic resonance imaging (MRI) and computed tomography (CT). For quantitative evaluation, two radiologists rated the quality of the synthesized images regarding "realistic image appearance", "anatomical correctness", and "consistency between slices". Furthermore, we demonstrate that synthetic images can be used in self-supervised pre-training and improve the performance of breast segmentation models when data is scarce (Dice scores, 0.91 [without synthetic data], 0.95 [with synthetic data]).

Automation Bias in Mammography: The Impact of Artificial Intelligence BI-RADS Suggestions on Reader Performance.

Background Automation bias (the propensity for humans to favor suggestions from automated decision-making systems) is a known source of error in human-machine interactions, but its implications regarding artificial intelligence (AI)-aided mammography reading are unknown. Purpose To determine how automation bias can affect inexperienced, moderately experienced, and very experienced radiologists when reading mammograms with the aid of an artificial intelligence (AI) system. Materials and Methods In this prospective experiment, 27 radiologists read 50 mammograms and provided their Breast Imaging Reporting and Data System (BI-RADS) assessment assisted by a purported AI system. Mammograms were obtained between January 2017 and December 2019 and were presented in two randomized sets. The first was a training set of 10 mammograms, with the correct BI-RADS category suggested by the AI system. The second was a set of 40 mammograms in which an incorrect BI-RADS category was suggested for 12 mammograms. Reader performance, degree of bias in BI-RADS scoring, perceived accuracy of the AI system, and reader confidence in their own BI-RADS ratings were assessed using analysis of variance (ANOVA) and repeated-measures ANOVA followed by post hoc tests and Kruskal-Wallis tests followed by the Dunn post hoc test. Results The percentage of correctly rated mammograms by inexperienced (mean, 79.7% ± 11.7 [SD] vs 19.8% ± 14.0; P < .001; r = 0.93), moderately experienced (mean, 81.3% ± 10.1 vs 24.8% ± 11.6; P < .001; r = 0.96), and very experienced (mean, 82.3% ± 4.2 vs 45.5% ± 9.1; P = .003; r = 0.97) radiologists was significantly impacted by the correctness of the AI prediction of BI-RADS category. Inexperienced radiologists were significantly more likely to follow the suggestions of the purported AI when it incorrectly suggested a higher BI-RADS category than the actual ground truth compared with both moderately (mean degree of bias, 4.0 ± 1.8 vs 2.4 ± 1.5; P = .044; r = 0.46) and very (mean degree of bias, 4.0 ± 1.8 vs 1.2 ± 0.8; P = .009; r = 0.65) experienced readers. Conclusion The results show that inexperienced, moderately experienced, and very experienced radiologists reading mammograms are prone to automation bias when being supported by an AI-based system. This and other effects of human and machine interaction must be considered to ensure safe deployment and accurate diagnostic performance when combining human readers and AI. © RSNA, 2023 Supplemental material is available for this article. See also the editorial by Baltzer in this issue.

Clinical audit in European radiology: current status and recommendations for improvement endorsed by the European Society of Radiology (ESR).

Clinical audit is an important quality improvement activity and has significant benefits for patients in terms of enhanced care, safety, experience and outcomes. Clinical audit in support of radiation protection is mandated within the European Council Basic Safety Standards Directive (BSSD), 2013/59/Euratom. The European Society of Radiology (ESR) has recognised clinical audit as an area of particular importance in the delivery of safe and effective health care. The ESR, alongside other European organisations and professional bodies, has developed a range of clinical audit-related initiatives to support European radiology departments in developing a clinical audit infrastructure and fulfilling their legal obligations. However, work by the European Commission, the ESR and other agencies has demonstrated a persisting variability in clinical audit uptake and implementation across Europe and a lack of awareness of the BSSD clinical audit requirements. In recognition of these findings, the European Commission supported the QuADRANT project, led by the ESR and in partnership with ESTRO (European Association of Radiotherapy and Oncology) and EANM (European Association of Nuclear Medicine). QuADRANT was a 30-month project which completed in Summer 2022, aiming to provide an overview of the status of European clinical audit and identifying barriers and challenges to clinical audit uptake and implementation. This paper summarises the current position of European radiological clinical audit and considers the barriers and challenges that exist. Reference is made to the QuADRANT project, and a range of potential solutions are suggested to enhance radiological clinical audit across Europe.

Artificial intelligence in coronary computed tomography angiography: Demands and solutions from a clinical perspective.

Coronary computed tomography angiography (CCTA) is increasingly the cornerstone in the management of patients with chronic coronary syndromes. This fact is reflected by current guidelines, which show a fundamental shift towards non-invasive imaging - especially CCTA. The guidelines for acute and stable coronary artery disease (CAD) of the European Society of Cardiology from 2019 and 2020 emphasize this shift. However, to fulfill this new role, a broader availability in adjunct with increased robustness of data acquisition and speed of data reporting of CCTA is needed. Artificial intelligence (AI) has made enormous progress for all imaging methodologies concerning (semi)-automatic tools for data acquisition and data post-processing, with outreach toward decision support systems. Besides onco- and neuroimaging, cardiac imaging is one of the main areas of application. Most current AI developments in the scenario of cardiac imaging are related to data postprocessing. However, AI applications (including radiomics) for CCTA also should enclose data acquisition (especially the fact of dose reduction) and data interpretation (presence and extent of CAD). The main effort will be to integrate these AI-driven processes into the clinical workflow, and to combine imaging data/results with further clinical data, thus - beyond the diagnosis of CAD- enabling prediction and forecast of morbidity and mortality. Furthermore, data fusing for therapy planning (e.g., invasive angiography/TAVI planning) will be warranted. The aim of this review is to present a holistic overview of AI applications in CCTA (including radiomics) under the umbrella of clinical workflows and clinical decision-making. The review first summarizes and analyzes applications for the main role of CCTA, i.e., to non-invasively rule out stable coronary artery disease. In the second step, AI applications for additional diagnostic purposes, i.e., to improve diagnostic power (CAC = coronary artery classifications), improve differential diagnosis (CT-FFR and CT perfusion), and finally improve prognosis (again CAC plus epi- and pericardial fat analysis) are reviewed.

An overview and a roadmap for artificial intelligence in hematology and oncology.

BACKGROUND: Artificial intelligence (AI) is influencing our society on many levels and has broad implications for the future practice of hematology and oncology. However, for many medical professionals and researchers, it often remains unclear what AI can and cannot do, and what are promising areas for a sensible application of AI in hematology and oncology. Finally, the limits and perils of using AI in oncology are not obvious to many healthcare professionals. METHODS: In this article, we provide an expert-based consensus statement by the joint Working Group on "Artificial Intelligence in Hematology and Oncology" by the German Society of Hematology and Oncology (DGHO), the German Association for Medical Informatics, Biometry and Epidemiology (GMDS), and the Special Interest Group Digital Health of the German Informatics Society (GI). We provide a conceptual framework for AI in hematology and oncology. RESULTS: First, we propose a technological definition, which we deliberately set in a narrow frame to mainly include the technical developments of the last ten years. Second, we present a taxonomy of clinically relevant AI systems, structured according to the type of clinical data they are used to analyze. Third, we show an overview of potential applications, including clinical, research, and educational environments with a focus on hematology and oncology. CONCLUSION: Thus, this article provides a point of reference for hematologists and oncologists, and at the same time sets forth a framework for the further development and clinical deployment of AI in hematology and oncology in the future.