Explanation and Elaboration with Examples for CLEAR (CLEAR-E3): an EuSoMII Radiomics Auditing Group Initiative.

Overall quality of radiomics research has been reported as low in literature, which constitutes a major challenge to improve. Consistent, transparent, and accurate reporting is critical, which can be accomplished with systematic use of reporting guidelines. The CheckList for EvaluAtion of Radiomics research (CLEAR) was previously developed to assist authors in reporting their radiomic research and to assist reviewers in their evaluation. To take full advantage of CLEAR, further explanation and elaboration of each item, as well as literature examples, may be useful. The main goal of this work, Explanation and Elaboration with Examples for CLEAR (CLEAR-E3), is to improve CLEAR's usability and dissemination. In this international collaborative effort, members of the European Society of Medical Imaging Informatics-Radiomics Auditing Group searched radiomics literature to identify representative reporting examples for each CLEAR item. At least two examples, demonstrating optimal reporting, were presented for each item. All examples were selected from open-access articles, allowing users to easily consult the corresponding full-text articles. In addition to these, each CLEAR item's explanation was further expanded and elaborated. For easier access, the resulting document is available at https://radiomic.github.io/CLEAR-E3/ . As a complementary effort to CLEAR, we anticipate that this initiative will assist authors in reporting their radiomics research with greater ease and transparency, as well as editors and reviewers in reviewing manuscripts.Relevance statement Along with the original CLEAR checklist, CLEAR-E3 is expected to provide a more in-depth understanding of the CLEAR items, as well as concrete examples for reporting and evaluating radiomic research.Key points• As a complementary effort to CLEAR, this international collaborative effort aims to assist authors in reporting their radiomics research, as well as editors and reviewers in reviewing radiomics manuscripts.• Based on positive examples from the literature selected by the EuSoMII Radiomics Auditing Group, each CLEAR item explanation was further elaborated in CLEAR-E3.• The resulting explanation and elaboration document with examples can be accessed at  https://radiomic.github.io/CLEAR-E3/ .

CT and MRI radiomics of bone and soft-tissue sarcomas: an updated systematic review of reproducibility and validation strategies.

OBJECTIVE: To systematically review radiomic feature reproducibility and model validation strategies in recent studies dealing with CT and MRI radiomics of bone and soft-tissue sarcomas, thus updating a previous version of this review which included studies published up to 2020. METHODS: A literature search was conducted on EMBASE and PubMed databases for papers published between January 2021 and March 2023. Data regarding radiomic feature reproducibility and model validation strategies were extracted and analyzed. RESULTS: Out of 201 identified papers, 55 were included. They dealt with radiomics of bone (n = 23) or soft-tissue (n = 32) tumors. Thirty-two (out of 54 employing manual or semiautomatic segmentation, 59%) studies included a feature reproducibility analysis. Reproducibility was assessed based on intra/interobserver segmentation variability in 30 (55%) and geometrical transformations of the region of interest in 2 (4%) studies. At least one machine learning validation technique was used for model development in 34 (62%) papers, and K-fold cross-validation was employed most frequently. A clinical validation of the model was reported in 38 (69%) papers. It was performed using a separate dataset from the primary institution (internal test) in 22 (40%), an independent dataset from another institution (external test) in 14 (25%) and both in 2 (4%) studies. CONCLUSIONS: Compared to papers published up to 2020, a clear improvement was noted with almost double publications reporting methodological aspects related to reproducibility and validation. Larger multicenter investigations including external clinical validation and the publication of databases in open-access repositories could further improve methodology and bring radiomics from a research area to the clinical stage. CRITICAL RELEVANCE STATEMENT: An improvement in feature reproducibility and model validation strategies has been shown in this updated systematic review on radiomics of bone and soft-tissue sarcomas, highlighting efforts to enhance methodology and bring radiomics from a research area to the clinical stage. KEY POINTS: • 2021-2023 radiomic studies on CT and MRI of musculoskeletal sarcomas were reviewed. • Feature reproducibility was assessed in more than half (59%) of the studies. • Model clinical validation was performed in 69% of the studies. • Internal (44%) and/or external (29%) test datasets were employed for clinical validation.

Executive Functions Assessment Based on Wireless EEG and 3D Gait Analysis During Dual-Task: A Feasibility Study.

Executive functions (EFs) are neurocognitive processes planning and regulating daily life actions. Performance of two simultaneous tasks, requiring the same cognitive resources, lead to a cognitive fatigue. Several studies investigated cognitive-motor task and the interference during walking, highlighting an increasing risk of falls especially in elderly and people with neurological diseases. A few studies instrumentally explored relationship between activation-no-activation of two EFs (working memory and inhibition) and spatial-temporal gait parameters. Aim of our study was to detect activation of inhibition and working memory during progressive difficulty levels of cognitive tasks and spontaneous walking using, respectively, wireless electroencephalography (EEG) and 3D-gait analysis. Thirteen healthy subjects were recruited. Two cognitive tasks were performed, activating inhibition (Go-NoGo) and working memory (N-back). EEG features (absolute and relative power in different bands) and kinematic parameters (7 spatial-temporal ones and Gait Variable Score for 9 range of motion of lower limbs) were analyzed. A significant decrease of stride length and an increase of external-rotation of foot progression were found during dual task with Go-NoGo. Moreover, a significant correlation was found between the relative power in the delta band at channels Fz, C4 and progressive difficulty levels of Go-NoGo (activating inhibition) during walking, whereas working memory showed no correlation. This study reinforces the hypothesis of the prevalent involvement of inhibition with respect to working memory during dual task walking and reveals specific kinematic adaptations. The foundations for EEG-based monitoring of cognitive processes involved in gait are laid. Clinical and Translational Impact Statement: Clinical and instrumental evaluation and training of executive functions (as inhibition), during cognitive-motor task, could be useful for rehabilitation treatment of gait disorder in elderly and people with neurological disease.

Effects of Interobserver Segmentation Variability and Intensity Discretization on MRI-Based Radiomic Feature Reproducibility of Lipoma and Atypical Lipomatous Tumor.

Segmentation and image intensity discretization impact on radiomics workflow. The aim of this study is to investigate the influence of interobserver segmentation variability and intensity discretization methods on the reproducibility of MRI-based radiomic features in lipoma and atypical lipomatous tumor (ALT). Thirty patients with lipoma or ALT were retrospectively included. Three readers independently performed manual contour-focused segmentation on T1-weighted and T2-weighted sequences, including the whole tumor volume. Additionally, a marginal erosion was applied to segmentations to evaluate its influence on feature reproducibility. After image pre-processing, with included intensity discretization employing both fixed bin number and width approaches, 1106 radiomic features were extracted from each sequence. Intraclass correlation coefficient (ICC) 95% confidence interval lower bound ≥ 0.75 defined feature stability. In contour-focused vs. margin shrinkage segmentation, the rates of stable features extracted from T1-weighted and T2-weighted images ranged from 92.68 to 95.21% vs. 90.69 to 95.66% after fixed bin number discretization and from 95.75 to 97.65% vs. 95.39 to 96.47% after fixed bin width discretization, respectively, with no difference between the two segmentation approaches (p ≥ 0.175). Higher stable feature rates and higher feature ICC values were found when implementing discretization with fixed bin width compared to fixed bin number, regardless of the segmentation approach (p < 0.001). In conclusion, MRI radiomic features of lipoma and ALT are reproducible regardless of the segmentation approach and intensity discretization method, although a certain degree of interobserver variability highlights the need for a preliminary reliability analysis in future studies.

Quality assessment of the MRI-radiomics studies for MGMT promoter methylation prediction in glioma: a systematic review and meta-analysis.

OBJECTIVES: To evaluate the methodological quality and diagnostic accuracy of MRI-based radiomic studies predicting O6-methylguanine-DNA methyltransferase (MGMT) promoter methylation status in gliomas. METHODS: PubMed Medline, EMBASE, and Web of Science were searched to identify MRI-based radiomic studies on MGMT methylation in gliomas published until December 31, 2022. Three raters evaluated the study methodological quality with Radiomics Quality Score (RQS, 16 components) and Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis Or Diagnosis (TRIPOD, 22 items) scales. Risk of bias and applicability concerns were assessed with QUADAS-2 tool. A meta-analysis was performed to estimate the pooled area under the curve (AUC) and to assess inter-study heterogeneity. RESULTS: We included 26 studies, published from 2016. The median RQS total score was 8 out of 36 (22%, range 8-44%). Thirteen studies performed external validation. All studies reported AUC or accuracy, but only 4 (15%) performed calibration and decision curve analysis. No studies performed phantom analysis, cost-effectiveness analysis, and prospective validation. The overall TRIPOD adherence score was between 50% and 70% in 16 studies and below 50% in 10 studies. The pooled AUC was 0.78 (95% CI, 0.73-0.83, I2 = 94.1%) with a high inter-study heterogeneity. Studies with external validation and including only WHO-grade IV gliomas had significantly lower AUC values (0.65; 95% CI, 0.57-0.73, p < 0.01). CONCLUSIONS: Study RQS and adherence to TRIPOD guidelines was generally low. Radiomic prediction of MGMT methylation status showed great heterogeneity of results and lower performances in grade IV gliomas, which hinders its current implementation in clinical practice. CLINICAL RELEVANCE STATEMENT: MGMT promoter methylation status appears to be variably correlated with MRI radiomic features; radiomic models are not sufficiently robust to be integrated into clinical practice to accurately predict MGMT promoter methylation status in patients with glioma before surgery. KEY POINTS: • Adherence to the indications of TRIPOD guidelines was generally low, as was RQS total score. • MGMT promoter methylation status prediction with MRI radiomic features provided heterogeneous diagnostic accuracy results across studies. • Studies that included grade IV glioma only and performed external validation had significantly lower diagnostic accuracy than others.

Development and Validation of an Explainable Radiomics Model to Predict High-Aggressive Prostate Cancer: A Multicenter Radiomics Study Based on Biparametric MRI.

In the last years, several studies demonstrated that low-aggressive (Grade Group (GG) ≤ 2) and high-aggressive (GG ≥ 3) prostate cancers (PCas) have different prognoses and mortality. Therefore, the aim of this study was to develop and externally validate a radiomic model to noninvasively classify low-aggressive and high-aggressive PCas based on biparametric magnetic resonance imaging (bpMRI). To this end, 283 patients were retrospectively enrolled from four centers. Features were extracted from apparent diffusion coefficient (ADC) maps and T2-weighted (T2w) sequences. A cross-validation (CV) strategy was adopted to assess the robustness of several classifiers using two out of the four centers. Then, the best classifier was externally validated using the other two centers. An explanation for the final radiomics signature was provided through Shapley additive explanation (SHAP) values and partial dependence plots (PDP). The best combination was a naïve Bayes classifier trained with ten features that reached promising results, i.e., an area under the receiver operating characteristic (ROC) curve (AUC) of 0.75 and 0.73 in the construction and external validation set, respectively. The findings of our work suggest that our radiomics model could help distinguish between low- and high-aggressive PCa. This noninvasive approach, if further validated and integrated into a clinical decision support system able to automatically detect PCa, could help clinicians managing men with suspicion of PCa.

Prediction of diabetes insipidus occurrence after endoscopic endonasal removal of sellar lesions using MRI-based radiomics and machine learning.

BACKGROUND: Pituitary adenomas and craniopharyngiomas are the most common lesions of the sellar region. These tumors are responsible for invasion or compression of crucial neurovascular structures. The involvement of the pituitary stalk warrants high rates of both pre- and post- operative diabetes insipidus. The aim of our study was to assess the accuracy of machine learning analysis from preoperative MRI of pituitary adenomas and craniopharyngiomas for the prediction of DI occurrence. METHODS: All patients underwent MRI exams either on a 1.5- or 3-T MR scanner from two Institutions, including coronal T2-weighted (T2-w) and contrast-enhanced T1-weighted (CE T1-w) Turbo Spin Echo sequences. Feature selection was carried out as a multi-step process, with a threshold of 0.75 to identify robust features. Further feature selection steps included filtering based on feature variance (threshold >0.01) and pairwise correlation (threshold <0.80). A Bayesian Network model was trained with 10-fold cross validation employing SMOTE to balance classes exclusively within the training folds. RESULTS: Thirty patients were included in this study. In total 2394 features were extracted and 1791 (75%) resulted stable after ICC analysis. The number of variant features was 1351 and of non-colinear features was 125. Finally, 10 features were selected by oneR ranking. The Bayesian Network model showed an accuracy of 63% with a precision of 77% for DI prediction (0.68 area under the precision-recall curve). CONCLUSIONS: We assessed the accuracy of machine learning analysis of texture-derived parameters from preoperative MRI of pituitary adenomas and craniopharyngiomas for the prediction of DI occurrence.

Large language models in radiology: fundamentals, applications, ethical considerations, risks, and future directions.

With the advent of large language models (LLMs), the artificial intelligence revolution in medicine and radiology is now more tangible than ever. Every day, an increasingly large number of articles are published that utilize LLMs in radiology. To adopt and safely implement this new technology in the field, radiologists should be familiar with its key concepts, understand at least the technical basics, and be aware of the potential risks and ethical considerations that come with it. In this review article, the authors provide an overview of the LLMs that might be relevant to the radiology community and include a brief discussion of their short history, technical basics, ChatGPT, prompt engineering, potential applications in medicine and radiology, advantages, disadvantages and risks, ethical and regulatory considerations, and future directions.

Reproducibility of radiomics quality score: an intra- and inter-rater reliability study.

OBJECTIVES: To investigate the intra- and inter-rater reliability of the total radiomics quality score (RQS) and the reproducibility of individual RQS items' score in a large multireader study. METHODS: Nine raters with different backgrounds were randomly assigned to three groups based on their proficiency with RQS utilization: Groups 1 and 2 represented the inter-rater reliability groups with or without prior training in RQS, respectively; group 3 represented the intra-rater reliability group. Thirty-three original research papers on radiomics were evaluated by raters of groups 1 and 2. Of the 33 papers, 17 were evaluated twice with an interval of 1 month by raters of group 3. Intraclass coefficient (ICC) for continuous variables, and Fleiss' and Cohen's kappa (k) statistics for categorical variables were used. RESULTS: The inter-rater reliability was poor to moderate for total RQS (ICC 0.30-055, p < 0.001) and very low to good for item's reproducibility (k - 0.12 to 0.75) within groups 1 and 2 for both inexperienced and experienced raters. The intra-rater reliability for total RQS was moderate for the less experienced rater (ICC 0.522, p = 0.009), whereas experienced raters showed excellent intra-rater reliability (ICC 0.91-0.99, p < 0.001) between the first and second read. Intra-rater reliability on RQS items' score reproducibility was higher and most of the items had moderate to good intra-rater reliability (k - 0.40 to 1). CONCLUSIONS: Reproducibility of the total RQS and the score of individual RQS items is low. There is a need for a robust and reproducible assessment method to assess the quality of radiomics research. CLINICAL RELEVANCE STATEMENT: There is a need for reproducible scoring systems to improve quality of radiomics research and consecutively close the translational gap between research and clinical implementation. KEY POINTS: • Radiomics quality score has been widely used for the evaluation of radiomics studies. • Although the intra-rater reliability was moderate to excellent, intra- and inter-rater reliability of total score and point-by-point scores were low with radiomics quality score. • A robust, easy-to-use scoring system is needed for the evaluation of radiomics research.

Towards reproducible radiomics research: introduction of a database for radiomics studies.

OBJECTIVES: To investigate the model-, code-, and data-sharing practices in the current radiomics research landscape and to introduce a radiomics research database. METHODS: A total of 1254 articles published between January 1, 2021, and December 31, 2022, in leading radiology journals (European Radiology, European Journal of Radiology, Radiology, Radiology: Artificial Intelligence, Radiology: Cardiothoracic Imaging, Radiology: Imaging Cancer) were retrospectively screened, and 257 original research articles were included in this study. The categorical variables were compared using Fisher's exact tests or chi-square test and numerical variables using Student's t test with relation to the year of publication. RESULTS: Half of the articles (128 of 257) shared the model by either including the final model formula or reporting the coefficients of selected radiomics features. A total of 73 (28%) models were validated on an external independent dataset. Only 16 (6%) articles shared the data or used publicly available open datasets. Similarly, only 20 (7%) of the articles shared the code. A total of 7 (3%) articles both shared code and data. All collected data in this study is presented in a radiomics research database (RadBase) and could be accessed at https://github.com/EuSoMII/RadBase . CONCLUSION: According to the results of this study, the majority of published radiomics models were not technically reproducible since they shared neither model nor code and data. There is still room for improvement in carrying out reproducible and open research in the field of radiomics. CLINICAL RELEVANCE STATEMENT: To date, the reproducibility of radiomics research and open science practices within the radiomics research community are still very low. Ensuring reproducible radiomics research with model-, code-, and data-sharing practices will facilitate faster clinical translation. KEY POINTS: • There is a discrepancy between the number of published radiomics papers and the clinical implementation of these published radiomics models. • The main obstacle to clinical implementation is the lack of model-, code-, and data-sharing practices. • In order to translate radiomics research into clinical practice, the radiomics research community should adopt open science practices.

CT Coronary Angiography: Technical Approach and Atherosclerotic Plaque Characterization.

Coronary computed tomography angiography (CCTA) currently represents a robust imaging technique for the detection, quantification and characterization of coronary atherosclerosis. However, CCTA remains a challenging task requiring both high spatial and temporal resolution to provide motion-free images of the coronary arteries. Several CCTA features, such as low attenuation, positive remodeling, spotty calcification, napkin-ring and high pericoronary fat attenuation index have been proved as associated to high-risk plaques. This review aims to explore the role of CCTA in the characterization of high-risk atherosclerotic plaque and the recent advancements in CCTA technologies with a focus on radiomics plaque analysis.

Radiomics for the identification of extraprostatic extension with prostate MRI: a systematic review and meta-analysis.

OBJECTIVES: Extraprostatic extension (EPE) of prostate cancer (PCa) is predicted using clinical nomograms. Incorporating MRI could represent a leap forward, although poor sensitivity and standardization represent unsolved issues. MRI radiomics has been proposed for EPE prediction. The aim of the study was to systematically review the literature and perform a meta-analysis of MRI-based radiomics approaches for EPE prediction. MATERIALS AND METHODS: Multiple databases were systematically searched for radiomics studies on EPE detection up to June 2022. Methodological quality was appraised according to Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) tool and radiomics quality score (RQS). The area under the receiver operating characteristic curves (AUC) was pooled to estimate predictive accuracy. A random-effects model estimated overall effect size. Statistical heterogeneity was assessed with I2 value. Publication bias was evaluated with a funnel plot. Subgroup analyses were performed to explore heterogeneity. RESULTS: Thirteen studies were included, showing limitations in study design and methodological quality (median RQS 10/36), with high statistical heterogeneity. Pooled AUC for EPE identification was 0.80. In subgroup analysis, test-set and cross-validation-based studies had pooled AUC of 0.85 and 0.89 respectively. Pooled AUC was 0.72 for deep learning (DL)-based and 0.82 for handcrafted radiomics studies and 0.79 and 0.83 for studies with multiple and single scanner data, respectively. Finally, models with the best predictive performance obtained using radiomics features showed pooled AUC of 0.82, while those including clinical data of 0.76. CONCLUSION: MRI radiomics-powered models to identify EPE in PCa showed a promising predictive performance overall. However, methodologically robust, clinically driven research evaluating their diagnostic and therapeutic impact is still needed. CLINICAL RELEVANCE STATEMENT: Radiomics might improve the management of prostate cancer patients increasing the value of MRI in the assessment of extraprostatic extension. However, it is imperative that forthcoming research prioritizes confirmation studies and a stronger clinical orientation to solidify these advancements. KEY POINTS: • MRI radiomics deserves attention as a tool to overcome the limitations of MRI in prostate cancer local staging. • Pooled AUC was 0.80 for the 13 included studies, with high heterogeneity (84.7%, p < .001), methodological issues, and poor clinical orientation. • Methodologically robust radiomics research needs to focus on increasing MRI sensitivity and bringing added value to clinical nomograms at patient level.

Simultaneous 18F-FDG PET/MRI Radiomics and Machine Learning Analysis of the Primary Breast Tumor for the Preoperative Prediction of Axillary Lymph Node Status in Breast Cancer.

In this prospective study, 117 female patients (mean age = 53 years) with 127 histologically proven breast cancer lesions (lymph node (LN) positive = 85, LN negative = 42) underwent simultaneous 18F-FDG PET/MRI of the breast. Quantitative parameters were calculated from dynamic contrast-enhanced (DCE) imaging (tumor Mean Transit Time, Volume Distribution, Plasma Flow), diffusion-weighted imaging (DWI) (tumor ADCmean), and PET (tumor SUVmax, mean and minimum, SUVmean of ipsilateral breast parenchyma). Manual whole-lesion segmentation was also performed on DCE, T2-weighted, DWI, and PET images, and radiomic features were extracted. The dataset was divided into a training (70%) and a test set (30%). Multi-step feature selection was performed, and a support vector machine classifier was trained and tested for predicting axillary LN status. 13 radiomic features from DCE, DWI, T2-weighted, and PET images were selected for model building. The classifier obtained an accuracy of 79.8 (AUC = 0.798) in the training set and 78.6% (AUC = 0.839), with sensitivity and specificity of 67.9% and 100%, respectively, in the test set. A machine learning-based radiomics model comprising 18F-FDG PET/MRI radiomic features extracted from the primary breast cancer lesions allows high accuracy in non-invasive identification of axillary LN metastasis.

Current role of machine learning and radiogenomics in precision neuro-oncology.

In the past few years, artificial intelligence (AI) has been increasingly used to create tools that can enhance workflow in medicine. In particular, neuro-oncology has benefited from the use of AI and especially machine learning (ML) and radiogenomics, which are subfields of AI. ML can be used to develop algorithms that dynamically learn from available medical data in order to automatically do specific tasks. On the other hand, radiogenomics can identify relationships between tumor genetics and imaging features, thus possibly giving new insights into the pathophysiology of tumors. Therefore, ML and radiogenomics could help treatment tailoring, which is crucial in personalized neuro-oncology. The aim of this review is to illustrate current and possible future applications of ML and radiomics in neuro-oncology.

Dissemination of endometrial cancer MRI staging guidelines among young radiologists: an ESUR Junior Network survey.

OBJECTIVES: Imaging guidelines could play an important role in the training of radiologists, but the extent of their adoption in residency programs is unclear. With this survey, the European Society of Urogenital Radiology (ESUR) Junior Network aimed to assess the dissemination of the ESUR guidelines on endometrial cancer MRI staging (EC-ESUR guidelines) among young radiologists. METHODS: An online questionnaire targeted to last year radiology residents and radiologists in the first year of their career was designed. It included 24 questions, structured in 4 sections (i.e., background, general, acquisition protocol, interpretation, and reporting). The survey was active between April and May 2022, accepting answers worldwide. Answers were solicited with a social media campaign and with the support of national scientific societies. Subgroup analysis was performed based on variables such as subspecialty of interest and number of EC-ESUR guidelines consultations using the Wilcoxon rank sum test. RESULTS: In total, 118 participants completed the questionnaire, of which 94 (80%) were from Europe and 46 (39%) with a special interest in urogenital radiology. Overall, 68 (58%) stated that the guidelines were not part of their residency teaching programs while 32 (27%) had never even consulted the guidelines. Interest in urogenital radiology as a subspecialty and EC-ESUR guidelines consultations were associated with greater confidence in supervising scan acquisition, interpreting, and reporting EC MRI staging exams. CONCLUSION: Four years after publication, the adoption of EC-ESUR guidelines in residency programs is heterogeneously low. Despite a possible selection bias, our findings indicate that active promotion of EC-ESUR guidelines is required. KEY POINTS: • The adoption of ESUR guidelines on endometrial cancer in radiology residency programs is heterogeneous. • Almost one third of respondents stated they had never even consulted the guidelines. • Confidence toward guidelines was higher in those who were exposed to more endometrial cancer MRI staging scans. • Reading the guidelines was associated with a greater confidence in protocol acquisition, interpretation, and reporting. • Active efforts to promote their dissemination are required.