RESUMEN
BACKGROUND: The need for developing new biomarkers is increasing with the emergence of many targeted therapies. Artificial Intelligence (AI) algorithms have shown great promise in the medical imaging field to build predictive models. We developed a prognostic model for solid tumour patients using AI on multimodal data. PATIENTS AND METHODS: Our retrospective study included examinations of patients with seven different cancer types performed between 2003 and 2017 in 17 different hospitals. Radiologists annotated all metastases on baseline computed tomography (CT) and ultrasound (US) images. Imaging features were extracted using AI models and used along with the patients' and treatments' metadata. A Cox regression was fitted to predict prognosis. Performance was assessed on a left-out test set with 1000 bootstraps. RESULTS: The model was built on 436 patients and tested on 196 patients (mean age 59, IQR: 51-6, 411 men out of 616 patients). On the whole, 1147 US images were annotated with lesions delineation, and 632 thorax-abdomen-pelvis CTs (total of 301,975 slices) were fully annotated with a total of 9516 lesions. The developed model reaches an average concordance index of 0.71 (0.67-0.76, 95% CI). Using the median predicted risk as a threshold value, the model is able to significantly (log-rank test P value < 0.001) isolate high-risk patients from low-risk patients (respective median OS of 11 and 31 months) with a hazard ratio of 3.5 (2.4-5.2, 95% CI). CONCLUSION: AI was able to extract prognostic features from imaging data, and along with clinical data, allows an accurate stratification of patients' prognoses.
Asunto(s)
Inteligencia Artificial , Neoplasias , Biomarcadores , Humanos , Masculino , Persona de Mediana Edad , Neoplasias/diagnóstico por imagen , Estudios Retrospectivos , Tomografía Computarizada por Rayos X/métodosRESUMEN
PURPOSE: The purpose of this study was to develop a fast and automatic algorithm to detect and segment lymphadenopathy from head and neck computed tomography (CT) examination. MATERIALS AND METHODS: An ensemble of three convolutional neural networks (CNNs) based on a U-Net architecture were trained to segment the lymphadenopathies in a fully supervised framework. The resulting predictions were assessed using the Dice similarity coefficient (DSC) on examinations presenting one or more adenopathies. On examinations without adenopathies, the score was given by the formula M/(M+A) where M was the mean adenopathy volume per patient and A the volume segmented by the algorithm. The networks were trained on 117 annotated CT acquisitions. RESULTS: The test set included 150 additional CT acquisitions unseen during the training. The performance on the test set yielded a mean score of 0.63. CONCLUSION: Despite limited available data and partial annotations, our CNN based approach achieved promising results in the task of cervical lymphadenopathy segmentation. It has the potential to bring precise quantification to the clinical workflow and to assist the clinician in the detection task.
Asunto(s)
Aprendizaje Profundo , Linfadenopatía , Humanos , Procesamiento de Imagen Asistido por Computador , Linfadenopatía/diagnóstico por imagen , Redes Neurales de la Computación , Tomografía Computarizada por Rayos XRESUMEN
PURPOSE: The purpose of this study was to develop and evaluate an algorithm that can automatically estimate the amount of coronary artery calcium (CAC) from unenhanced electrocardiography (ECG)-gated computed tomography (CT) cardiac volume acquisitions by using convolutional neural networks (CNN). MATERIALS AND METHODS: The method used a set of five CNN with three-dimensional (3D) U-Net architecture trained on a database of 783 CT examinations to detect and segment coronary artery calcifications in a 3D volume. The Agatston score, the conventional CAC scoring, was then computed slice by slice from the resulting segmentation mask and compared to the ground truth manually estimated by radiologists. The quality of the estimation was assessed with the concordance index (C-index) on CAC risk category on a separate testing set of 98 independent CT examinations. RESULTS: The final model yielded a C-index of 0.951 on the testing set. The remaining errors of the method were mainly observed on small-size and/or low-density calcifications, or calcifications located near the mitral valve or ring. CONCLUSION: The deep learning-based method proposed here to compute automatically the CAC score from unenhanced-ECG-gated cardiac CT is fast, robust and yields accuracy similar to those of other artificial intelligence methods, which could improve workflow efficiency, eliminating the time spent on manually selecting coronary calcifications to compute the Agatston score.
Asunto(s)
Calcio , Aprendizaje Profundo , Inteligencia Artificial , Vasos Coronarios/diagnóstico por imagen , Electrocardiografía , Humanos , Tomografía Computarizada por Rayos XRESUMEN
PURPOSE: The purpose of this study was to create a deep learning algorithm to infer the benign or malignant nature of breast nodules using two-dimensional B-mode ultrasound data initially marked as BI-RADS 3 and 4. MATERIALS AND METHODS: An ensemble of mask region-based convolutional neural networks (Mask-RCNN) combining nodule segmentation and classification were trained to explicitly localize the nodule and generate a probability of the nodule to be malignant on two-dimensional B-mode ultrasound. These probabilities were aggregated at test time to produce final results. Resulting inferences were assessed using area under the curve (AUC). RESULTS: A total of 460 ultrasound images of breast nodules classified as BI-RADS 3 or 4 were included. There were 295 benign and 165 malignant breast nodules used for training and validation, and another 137 breast nodules images used for testing. As a part of the challenge, the distribution of benign and malignant breast nodules in the test database remained unknown. The obtained AUC was 0.69 (95% CI: 0.57-0.82) on the training set and 0.67 on the test set. CONCLUSION: The proposed deep learning solution helps classify benign and malignant breast nodules based solely on two-dimensional ultrasound images initially marked as BIRADS 3 and 4.
Asunto(s)
Algoritmos , Redes Neurales de la Computación , Área Bajo la Curva , Humanos , UltrasonografíaRESUMEN
PURPOSE: The 2020 edition of these Data Challenges was organized by the French Society of Radiology (SFR), from September 28 to September 30, 2020. The goals were to propose innovative artificial intelligence solutions for the current relevant problems in radiology and to build a large database of multimodal medical images of ultrasound and computed tomography (CT) on these subjects from several French radiology centers. MATERIALS AND METHODS: This year the attempt was to create data challenge objectives in line with the clinical routine of radiologists, with less preprocessing of data and annotation, leaving a large part of the preprocessing task to the participating teams. The objectives were proposed by the different organizations depending on their core areas of expertise. A dedicated platform was used to upload the medical image data, to automatically anonymize the uploaded data. RESULTS: Three challenges were proposed including classification of benign or malignant breast nodules on ultrasound examinations, detection and contouring of pathological neck lymph nodes from cervical CT examinations and classification of calcium score on coronary calcifications from thoracic CT examinations. A total of 2076 medical examinations were included in the database for the three challenges, in three months, by 18 different centers, of which 12% were excluded. The 39 participants were divided into six multidisciplinary teams among which the coronary calcification score challenge was solved with a concordance index > 95%, and the other two with scores of 67% (breast nodule classification) and 63% (neck lymph node calcifications).
Asunto(s)
Inteligencia Artificial , Tomografía Computarizada por Rayos X , Humanos , Radiólogos , UltrasonografíaRESUMEN
The SARS-COV-2 pandemic has put pressure on intensive care units, so that identifying predictors of disease severity is a priority. We collect 58 clinical and biological variables, and chest CT scan data, from 1003 coronavirus-infected patients from two French hospitals. We train a deep learning model based on CT scans to predict severity. We then construct the multimodal AI-severity score that includes 5 clinical and biological variables (age, sex, oxygenation, urea, platelet) in addition to the deep learning model. We show that neural network analysis of CT-scans brings unique prognosis information, although it is correlated with other markers of severity (oxygenation, LDH, and CRP) explaining the measurable but limited 0.03 increase of AUC obtained when adding CT-scan information to clinical variables. Here, we show that when comparing AI-severity with 11 existing severity scores, we find significantly improved prognosis performance; AI-severity can therefore rapidly become a reference scoring approach.