RESUMO
Background & Aims: Body composition assessment (BCA) parameters have recently been identified as relevant prognostic factors for patients with hepatocellular carcinoma (HCC). Herein, we aimed to investigate the role of BCA parameters for prognosis prediction in patients with HCC undergoing transarterial chemoembolization (TACE). Methods: This retrospective multicenter study included a total of 754 treatment-naïve patients with HCC who underwent TACE at six tertiary care centers between 2010-2020. Fully automated artificial intelligence-based quantitative 3D volumetry of abdominal cavity tissue composition was performed to assess skeletal muscle volume (SM), total adipose tissue (TAT), intra- and intermuscular adipose tissue, visceral adipose tissue, and subcutaneous adipose tissue (SAT) on pre-intervention computed tomography scans. BCA parameters were normalized to the slice number of the abdominal cavity. We assessed the influence of BCA parameters on median overall survival and performed multivariate analysis including established estimates of survival. Results: Univariate survival analysis revealed that impaired median overall survival was predicted by low SM (p <0.001), high TAT volume (p = 0.013), and high SAT volume (p = 0.006). In multivariate survival analysis, SM remained an independent prognostic factor (p = 0.039), while TAT and SAT volumes no longer showed predictive ability. This predictive role of SM was confirmed in a subgroup analysis of patients with BCLC stage B. Conclusions: SM is an independent prognostic factor for survival prediction. Thus, the integration of SM into novel scoring systems could potentially improve survival prediction and clinical decision-making. Fully automated approaches are needed to foster the implementation of this imaging biomarker into daily routine. Impact and implications: Body composition assessment parameters, especially skeletal muscle volume, have been identified as relevant prognostic factors for many diseases and treatments. In this study, skeletal muscle volume has been identified as an independent prognostic factor for patients with hepatocellular carcinoma undergoing transarterial chemoembolization. Therefore, skeletal muscle volume as a metaparameter could play a role as an opportunistic biomarker in holistic patient assessment and be integrated into decision support systems. Workflow integration with artificial intelligence is essential for automated, quantitative body composition assessment, enabling broad availability in multidisciplinary case discussions.
RESUMO
BACKGROUND: Impaired microcirculation is a cornerstone of sepsis development and leads to reduced tissue oxygenation, influenced by fluid and catecholamine administration during treatment. Hyperspectral imaging (HSI) is a non-invasive bedside technology for visualizing physicochemical tissue characteristics. Machine learning (ML) for skin HSI might offer an automated approach for bedside microcirculation assessment, providing an individualized tissue fingerprint of critically ill patients in intensive care. The study aimed to determine if machine learning could be utilized to automatically identify regions of interest (ROIs) in the hand, thereby distinguishing between healthy individuals and critically ill patients with sepsis using HSI. METHODS: HSI raw data from 75 critically ill sepsis patients and from 30 healthy controls were recorded using TIVITA® Tissue System and analyzed using an automated ML approach. Additionally, patients were divided into two groups based on their SOFA scores for further subanalysis: less severely ill (SOFA ≤ 5) and severely ill (SOFA > 5). The analysis of the HSI raw data was fully-automated using MediaPipe for ROI detection (palm and fingertips) and feature extraction. HSI Features were statistically analyzed to highlight relevant wavelength combinations using Mann-Whitney-U test and Benjamini, Krieger, and Yekutieli (BKY) correction. In addition, Random Forest models were trained using bootstrapping, and feature importances were determined to gain insights regarding the wavelength importance for a model decision. RESULTS: An automated pipeline for generating ROIs and HSI feature extraction was successfully established. HSI raw data analysis accurately distinguished healthy controls from sepsis patients. Wavelengths at the fingertips differed in the ranges of 575-695 nm and 840-1000 nm. For the palm, significant differences were observed in the range of 925-1000 nm. Feature importance plots indicated relevant information in the same wavelength ranges. Combining palm and fingertip analysis provided the highest reliability, with an AUC of 0.92 to distinguish between sepsis patients and healthy controls. CONCLUSION: Based on this proof of concept, the integration of automated and standardized ROIs along with automated skin HSI analyzes, was able to differentiate between healthy individuals and patients with sepsis. This approach offers a reliable and objective assessment of skin microcirculation, facilitating the rapid identification of critically ill patients.
Assuntos
Estado Terminal , Imageamento Hiperespectral , Aprendizado de Máquina , Microcirculação , Humanos , Aprendizado de Máquina/normas , Masculino , Feminino , Microcirculação/fisiologia , Pessoa de Meia-Idade , Idoso , Imageamento Hiperespectral/métodos , Sepse/fisiopatologia , Sepse/diagnóstico , Adulto , Estudo de Prova de Conceito , Monitorização Fisiológica/métodos , Monitorização Fisiológica/instrumentaçãoRESUMO
Automated medical image analysis systems often require large amounts of training data with high quality labels, which are difficult and time consuming to generate. This paper introduces Radiology Object in COntext version 2 (ROCOv2), a multimodal dataset consisting of radiological images and associated medical concepts and captions extracted from the PMC Open Access subset. It is an updated version of the ROCO dataset published in 2018, and adds 35,705 new images added to PMC since 2018. It further provides manually curated concepts for imaging modalities with additional anatomical and directional concepts for X-rays. The dataset consists of 79,789 images and has been used, with minor modifications, in the concept detection and caption prediction tasks of ImageCLEFmedical Caption 2023. The dataset is suitable for training image annotation models based on image-caption pairs, or for multi-label image classification using Unified Medical Language System (UMLS) concepts provided with each image. In addition, it can serve for pre-training of medical domain models, and evaluation of deep learning models for multi-task learning.
Assuntos
Imagem Multimodal , Radiologia , Humanos , Processamento de Imagem Assistida por Computador , Unified Medical Language SystemRESUMO
The Sparsely Annotated Region and Organ Segmentation (SAROS) dataset was created using data from The Cancer Imaging Archive (TCIA) to provide a large open-access CT dataset with high-quality annotations of body landmarks. In-house segmentation models were employed to generate annotation proposals on randomly selected cases from TCIA. The dataset includes 13 semantic body region labels (abdominal/thoracic cavity, bones, brain, breast implant, mediastinum, muscle, parotid/submandibular/thyroid glands, pericardium, spinal cord, subcutaneous tissue) and six body part labels (left/right arm/leg, head, torso). Case selection was based on the DICOM series description, gender, and imaging protocol, resulting in 882 patients (438 female) for a total of 900 CTs. Manual review and correction of proposals were conducted in a continuous quality control cycle. Only every fifth axial slice was annotated, yielding 20150 annotated slices from 28 data collections. For the reproducibility on downstream tasks, five cross-validation folds and a test set were pre-defined. The SAROS dataset serves as an open-access resource for training and evaluating novel segmentation models, covering various scanner vendors and diseases.
Assuntos
Tomografia Computadorizada por Raios X , Imagem Corporal Total , Feminino , Humanos , Masculino , Processamento de Imagem Assistida por ComputadorRESUMO
Chronic Obstructive Pulmonary Disease (COPD) is characterized by progressive and irreversible airflow limitation, with individual body composition influencing disease severity. Severe emphysema worsens symptoms through hyperinflation, which can be relieved by bronchoscopic lung volume reduction (BLVR). To investigate how body composition, assessed through CT scans, impacts outcomes in emphysema patients undergoing BLVR. Fully automated CT-based body composition analysis (BCA) was performed in patients with end-stage emphysema receiving BLVR with valves. Post-interventional muscle and adipose tissues were quantified, body size-adjusted, and compared to baseline parameters. Between January 2015 and December 2022, 300 patients with severe emphysema underwent endobronchial valve treatment. Significant improvements were seen in outcome parameters, which were defined as changes in pulmonary function, physical performance, and quality of life (QoL) post-treatment. Muscle volume remained stable (1.632 vs. 1.635 for muscle bone adjusted ratio (BAR) at baseline and after 6 months respectively), while bone adjusted adipose tissue volumes, especially total and pericardial adipose tissue, showed significant increase (2.86 vs. 3.00 and 0.16 vs. 0.17, respectively). Moderate to strong correlations between bone adjusted muscle volume and weaker correlations between adipose tissue volumes and outcome parameters (pulmonary function, QoL and physical performance) were observed. Particularly after 6-month, bone adjusted muscle volume changes positively corresponded to improved outcomes (ΔForced expiratory volume in 1 s [FEV1], r = 0.440; ΔInspiratory vital capacity [IVC], r = 0.397; Δ6Minute walking distance [6MWD], r = 0.509 and ΔCOPD assessment test [CAT], r = -0.324; all p < 0.001). Group stratification by bone adjusted muscle volume changes revealed that groups with substantial muscle gain experienced a greater clinical benefit in pulmonary function improvements, QoL and physical performance (ΔFEV1%, 5.5 vs. 39.5; ΔIVC%, 4.3 vs. 28.4; Δ6MWDm, 14 vs. 110; ΔCATpts, -2 vs. -3.5 for groups with ΔMuscle, BAR% < -10 vs. > 10, respectively). BCA results among patients divided by the minimal clinically important difference for forced expiratory volume of the first second (FEV1) showed significant differences in bone-adjusted muscle and intramuscular adipose tissue (IMAT) volumes and their respective changes after 6 months (ΔMuscle, BAR% -5 vs. 3.4 and ΔIMAT, BAR% -0.62 vs. 0.60 for groups with ΔFEV1 ≤ 100 mL vs > 100 mL). Altered body composition, especially increased muscle volume, is associated with functional improvements in BLVR-treated patients.
Assuntos
Enfisema , Doença Pulmonar Obstrutiva Crônica , Enfisema Pulmonar , Humanos , Pneumonectomia/métodos , Qualidade de Vida , Broncoscopia/métodos , Enfisema Pulmonar/diagnóstico por imagem , Enfisema Pulmonar/cirurgia , Enfisema Pulmonar/etiologia , Enfisema/etiologia , Volume Expiratório Forçado/fisiologia , Composição Corporal , Tomografia Computadorizada por Raios X , Resultado do TratamentoRESUMO
A poor nutritional status is associated with worse pulmonary function and survival in people with cystic fibrosis (pwCF). CF transmembrane conductance regulator modulators can improve pulmonary function and body weight, but more data is needed to evaluate its effects on body composition. In this retrospective study, a pre-trained deep-learning network was used to perform a fully automated body composition analysis on chest CTs from 66 adult pwCF before and after receiving elexacaftor/tezacaftor/ivacaftor (ETI) therapy. Muscle and adipose tissues were quantified and divided by bone volume to obtain body size-adjusted ratios. After receiving ETI therapy, marked increases were observed in all adipose tissue ratios among pwCF, including the total adipose tissue ratio (+ 46.21%, p < 0.001). In contrast, only small, but statistically significant increases of the muscle ratio were measured in the overall study population (+ 1.63%, p = 0.008). Study participants who were initially categorized as underweight experienced more pronounced effects on total adipose tissue ratio (p = 0.002), while gains in muscle ratio were equally distributed across BMI categories (p = 0.832). Our findings suggest that ETI therapy primarily affects adipose tissues, not muscle tissue, in adults with CF. These effects are primarily observed among pwCF who were initially underweight. Our findings may have implications for the future nutritional management of pwCF.
Assuntos
Aminofenóis , Benzodioxóis , Composição Corporal , Fibrose Cística , Combinação de Medicamentos , Indóis , Quinolinas , Quinolonas , Humanos , Fibrose Cística/tratamento farmacológico , Fibrose Cística/fisiopatologia , Masculino , Adulto , Feminino , Composição Corporal/efeitos dos fármacos , Aminofenóis/uso terapêutico , Quinolonas/uso terapêutico , Benzodioxóis/uso terapêutico , Estudos Retrospectivos , Indóis/uso terapêutico , Pirazóis/uso terapêutico , Piridinas/uso terapêutico , Tomografia Computadorizada por Raios X , Adulto Jovem , Pirrolidinas/uso terapêutico , Regulador de Condutância Transmembrana em Fibrose Cística/genética , Tecido Adiposo/diagnóstico por imagem , Tecido Adiposo/efeitos dos fármacos , Tecido Adiposo/metabolismo , Estado NutricionalRESUMO
Targeted therapy with epidermal growth factor receptor (EGFR) tyrosine kinase inhibitors (TKIs) has established the precision oncology paradigm in lung cancer. Most patients with EGFR-mutated lung cancer respond but eventually acquire resistance. Methods: Patients exhibiting the EGFR p.T790M resistance biomarker benefit from sequenced targeted therapy with osimertinib. We hypothesized that metabolic response as detected by 18F-FDG PET after short-course osimertinib identifies additional patients susceptible to sequenced therapy. Results: Fourteen patients with EGFR-mutated lung cancer and resistance to first- or second-generation EGFR TKI testing negatively for EGFR p.T790M were enrolled in a phase II study. Five patients (36%) achieved a metabolic 18F-FDG PET response and continued osimertinib. In those, the median duration of treatment was not reached (95% CI, 24 mo to not estimable), median progression-free survival was 18.7 mo (95% CI, 14.6 mo to not estimable), and median overall survival was 41.5 mo. Conclusion: Connecting theranostic osimertinib treatment with early metabolic response assessment by PET enables early identification of patients with unknown mechanisms of TKI resistance who derive dramatic clinical benefit from sequenced osimertinib. This defines a novel paradigm for personalization of targeted therapies in patients with lung cancer dependent on a tractable driver oncogene.
Assuntos
Resistencia a Medicamentos Antineoplásicos , Receptores ErbB , Neoplasias Pulmonares , Terapia de Alvo Molecular , Mutação , Tomografia por Emissão de Pósitrons , Humanos , Neoplasias Pulmonares/diagnóstico por imagem , Neoplasias Pulmonares/tratamento farmacológico , Neoplasias Pulmonares/genética , Neoplasias Pulmonares/metabolismo , Receptores ErbB/metabolismo , Receptores ErbB/antagonistas & inibidores , Receptores ErbB/genética , Masculino , Feminino , Pessoa de Meia-Idade , Idoso , Compostos de Anilina/uso terapêutico , Fluordesoxiglucose F18 , Acrilamidas/uso terapêutico , Inibidores de Proteínas Quinases/uso terapêutico , Adulto , Idoso de 80 Anos ou mais , Indóis , PirimidinasRESUMO
OBJECTIVES: Accurately acquiring and assigning different contrast-enhanced phases in computed tomography (CT) is relevant for clinicians and for artificial intelligence orchestration to select the most appropriate series for analysis. However, this information is commonly extracted from the CT metadata, which is often wrong. This study aimed at developing an automatic pipeline for classifying intravenous (IV) contrast phases and additionally for identifying contrast media in the gastrointestinal tract (GIT). MATERIALS AND METHODS: This retrospective study used 1200 CT scans collected at the investigating institution between January 4, 2016 and September 12, 2022, and 240 CT scans from multiple centers from The Cancer Imaging Archive for external validation. The open-source segmentation algorithm TotalSegmentator was used to identify regions of interest (pulmonary artery, aorta, stomach, portal/splenic vein, liver, portal vein/hepatic veins, inferior vena cava, duodenum, small bowel, colon, left/right kidney, urinary bladder), and machine learning classifiers were trained with 5-fold cross-validation to classify IV contrast phases (noncontrast, pulmonary arterial, arterial, venous, and urographic) and GIT contrast enhancement. The performance of the ensembles was evaluated using the receiver operating characteristic area under the curve (AUC) and 95% confidence intervals (CIs). RESULTS: For the IV phase classification task, the following AUC scores were obtained for the internal test set: 99.59% [95% CI, 99.58-99.63] for the noncontrast phase, 99.50% [95% CI, 99.49-99.52] for the pulmonary-arterial phase, 99.13% [95% CI, 99.10-99.15] for the arterial phase, 99.8% [95% CI, 99.79-99.81] for the venous phase, and 99.7% [95% CI, 99.68-99.7] for the urographic phase. For the external dataset, a mean AUC of 97.33% [95% CI, 97.27-97.35] and 97.38% [95% CI, 97.34-97.41] was achieved for all contrast phases for the first and second annotators, respectively. Contrast media in the GIT could be identified with an AUC of 99.90% [95% CI, 99.89-99.9] in the internal dataset, whereas in the external dataset, an AUC of 99.73% [95% CI, 99.71-99.73] and 99.31% [95% CI, 99.27-99.33] was achieved with the first and second annotator, respectively. CONCLUSIONS: The integration of open-source segmentation networks and classifiers effectively classified contrast phases and identified GIT contrast enhancement using anatomical landmarks.
Assuntos
Meios de Contraste , Aprendizado de Máquina , Tomografia Computadorizada por Raios X , Humanos , Estudos Retrospectivos , Tomografia Computadorizada por Raios X/métodos , Masculino , Feminino , Trato Gastrointestinal/diagnóstico por imagem , Interpretação de Imagem Radiográfica Assistida por Computador/métodos , Pessoa de Meia-Idade , AlgoritmosRESUMO
Background: Primary central nervous system lymphomas (PCNSL) pose a challenge as they may mimic gliomas on magnetic resonance imaging (MRI) imaging, compelling precise differentiation for appropriate treatment. This study focuses on developing an automated MRI-based workflow to distinguish between PCNSL and gliomas. Methods: MRI examinations of 240 therapy-naive patients (141 males and 99 females, mean age: 55.16 years) with cerebral gliomas and PCNSLs (216 gliomas and 24 PCNSLs), each comprising a non-contrast T1-weighted, fluid-attenuated inversion recovery (FLAIR), and contrast-enhanced T1-weighted sequence were included in the study. HD-GLIO, a pre-trained segmentation network, was used to generate segmentations automatically. To validate the segmentation efficiency, 237 manual segmentations were prepared (213 gliomas and 24 PCNSLs). Subsequently, radiomics features were extracted following feature selection and training of an XGBoost algorithm for classification. Results: The segmentation models for gliomas and PCNSLs achieved a mean Sørensen-Dice coefficient of 0.82 and 0.80 for whole tumors, respectively. Three classification models were developed in this study to differentiate gliomas from PCNSLs. The first model differentiated PCNSLs from gliomas, with an area under the curve (AUC) of 0.99 (F1-score: 0.75). The second model discriminated between high-grade gliomas and PCNSLs with an AUC of 0.91 (F1-score: 0.6), and the third model differentiated between low-grade gliomas and PCNSLs with an AUC of 0.95 (F1-score: 0.89). Conclusions: This study serves as a pilot investigation presenting an automated virtual biopsy workflow that distinguishes PCNSLs from cerebral gliomas. Prior to clinical use, it is necessary to validate the results in a prospective multicenter setting with a larger number of PCNSL patients.
RESUMO
Background: This study aimed to evaluate the impact of an AI-assisted fracture detection program on radiology residents' performance in pediatric and adult trauma patients and assess its implications for residency training. Methods: This study, conducted retrospectively, included 200 radiographs from participants aged 1 to 95 years (mean age: 40.7 ± 24.5 years), encompassing various body regions. Among these, 50% (100/200) displayed at least one fracture, totaling one hundred thirty-five fractures, assessed by four radiology residents with different experience levels. A machine learning algorithm was employed for fracture detection, and the ground truth was established by consensus among two experienced senior radiologists. Fracture detection accuracy, reporting time, and confidence were evaluated with and without AI support. Results: Radiology residents' sensitivity for fracture detection improved significantly with AI support (58% without AI vs. 77% with AI, p < 0.001), while specificity showed minor improvements (77% without AI vs. 79% with AI, p = 0.0653). AI stand-alone performance achieved a sensitivity of 93% with a specificity of 77%. AI support for fracture detection significantly reduced interpretation time for radiology residents by an average of approximately 2.6 s (p = 0.0156) and increased resident confidence in the findings (p = 0.0013). Conclusion: AI support significantly enhanced fracture detection sensitivity among radiology residents, particularly benefiting less experienced radiologists. It does not compromise specificity and reduces interpretation time, contributing to improved efficiency. This study underscores AI's potential in radiology, emphasizing its role in training and interpretation improvement.
RESUMO
PURPOSE: The aim of this study was to investigate the potential of multiparametric 18F-FDG PET/MR imaging as a platform for radiomics analysis and machine learning algorithms based on primary cervical cancers to predict N- and M-stage in patients. MATERIALS AND METHODS: A total of 30 patients with histopathological confirmation of primary and untreated cervical cancer were prospectively enrolled for a multiparametric 18F-FDG PET/MR examination, comprising a dedicated protocol for imaging of the female pelvis. The primary tumor in the uterine cervix was manually segmented on post-contrast T1-weighted images. Quantitative features were extracted from the segmented tumors using the Radiomic Image Processing Toolbox for the R software environment for statistical computing and graphics. 45 different image features were calculated from non-enhanced as well as post-contrast T1-weighted TSE images, T2-weighted TSE images, the ADC map, the parametric Ktrans, Kep, Ve and iAUC maps and PET images, respectively. Statistical analysis and modeling was performed using Python 3.5 and the scikit-learn software machine learning library for the Python programming language. RESULTS: Prediction of M-stage was superior when compared to N-stage. Prediction of M-stage using SVM with SVM-RFE as feature selection obtained the highest performance providing sensitivity of 91â% and specificity of 92â%. Using receiver operating characteristic (ROC) analysis of the pooled predictions, the area under the curve (AUC) was 0.97. Prediction of N-stage using RBF-SVM with MIFS as feature selection reached sensitivity of 83â%, specificity of 67â% and an AUC of 0.82. CONCLUSION: M- and N-stage can be predicted based on isolated radiomics analyses of the primary tumor in cervical cancers, thus serving as a template for noninvasive tumor phenotyping and patient stratification using high-dimensional feature vectors extracted from multiparametric PET/MRI data. KEY POINTS: · Radiomics analysis based on multiparametric PET/MRI enables prediction of the metastatic status of cervical cancers. · Prediction of M-stage is superior to N-stage. · Multiparametric PET/MRI displays a valuable platform for radiomics analyses .
Assuntos
Neoplasias do Colo do Útero , Humanos , Feminino , Neoplasias do Colo do Útero/diagnóstico por imagem , Fluordesoxiglucose F18 , Radiômica , Estudos Retrospectivos , Imageamento por Ressonância MagnéticaRESUMO
A novel software, DiffTool, was developed in-house to keep track of changes made by board-certified radiologists to preliminary reports created by residents and evaluate its impact on radiological hands-on training. Before (t0) and after (t2-4) the deployment of the software, 18 residents (median age: 29 years; 33% female) completed a standardized questionnaire on professional training. At t2-4 the participants were also requested to respond to three additional questions to evaluate the software. Responses were recorded via a six-point Likert scale ranging from 1 ("strongly agree") to 6 ("strongly disagree"). Prior to the release of the software, 39% (7/18) of the residents strongly agreed with the statement that they manually tracked changes made by board-certified radiologists to each of their radiological reports while 61% were less inclined to agree with that statement. At t2-4, 61% (11/18) stated that they used DiffTool to track differences. Furthermore, we observed an increase from 33% (6/18) to 44% (8/18) of residents who agreed to the statement "I profit from every corrected report". The DiffTool was well accepted among residents with a regular user base of 72% (13/18), while 78% (14/18) considered it a relevant improvement to their training. The results of this study demonstrate the importance of providing a time-efficient way to analyze changes made to preliminary reports as an additive for professional training.
Assuntos
Internato e Residência , Radiologia , Humanos , Feminino , Adulto , Masculino , Radiografia , Software , RadiologistasRESUMO
ABSTRACT: Artificial intelligence (AI) techniques are currently harnessed to revolutionize the domain of medical imaging. This review investigates 3 major AI-driven approaches for contrast agent management: new frontiers in contrast agent dose reduction, the contrast-free question, and new applications. By examining recent studies that use AI as a new frontier in contrast media research, we synthesize the current state of the field and provide a comprehensive understanding of the potential and limitations of AI in this context. In doing so, we show the dose limits of reducing the amount of contrast agents and demonstrate why it might not be possible to completely eliminate contrast agents in the future. In addition, we highlight potential new applications to further increase the radiologist's sensitivity at normal doses. At the same time, this review shows which network architectures provide promising approaches and reveals possible artifacts of a paired image-to-image conversion. Furthermore, current US Food and Drug Administration regulatory guidelines regarding AI/machine learning-enabled medical devices are highlighted.
Assuntos
Inteligência Artificial , Meios de Contraste , Estados Unidos , Aprendizado de Máquina , Artefatos , United States Food and Drug AdministrationRESUMO
BACKGROUND: In recent years, AI has made significant advancements in medical diagnosis and prognosis. However, the incorporation of AI into clinical practice is still challenging and under-appreciated. We aim to demonstrate a possible vertical integration approach to close the loop for AI-ready radiology. METHOD: This study highlights the importance of two-way communication for AI-assisted radiology. As a key part of the methodology, it demonstrates the integration of AI systems into clinical practice with structured reports and AI visualization, giving more insight into the AI system. By integrating cooperative lifelong learning into the AI system, we ensure the long-term effectiveness of the AI system, while keeping the radiologist in the loop.â RESULTS: We demonstrate the use of lifelong learning for AI systems by incorporating AI visualization and structured reports. We evaluate Memory Aware-Synapses and Rehearsal approach and find that both approaches work in practice. Furthermore, we see the advantage of lifelong learning algorithms that do not require the storing or maintaining of samples from previous datasets. CONCLUSION: In conclusion, incorporating AI into the clinical routine of radiology requires a two-way communication approach and seamless integration of the AI system, which we achieve with structured reports and visualization of the insight gained by the model. Closing the loop for radiology leads to successful integration, enabling lifelong learning for the AI system, which is crucial for sustainable long-term performance. KEY POINTS: · The integration of AI systems into the clinical routine with structured reports and AI visualization.. · Two-way communication between AI and radiologists is necessary to enable AI that keeps the radiologist in the loop.. · Closing the loop enables lifelong learning, which is crucial for long-term, high-performing AI in radiology..
Assuntos
Inteligência Artificial , Radiologia , Humanos , Radiologia/métodos , Algoritmos , Radiologistas , RadiografiaRESUMO
OBJECTIVES: Provide physicians and researchers an efficient way to extract information from weakly structured radiology reports with natural language processing (NLP) machine learning models. METHODS: We evaluate seven different German bidirectional encoder representations from transformers (BERT) models on a dataset of 857,783 unlabeled radiology reports and an annotated reading comprehension dataset in the format of SQuAD 2.0 based on 1223 additional reports. RESULTS: Continued pre-training of a BERT model on the radiology dataset and a medical online encyclopedia resulted in the most accurate model with an F1-score of 83.97% and an exact match score of 71.63% for answerable questions and 96.01% accuracy in detecting unanswerable questions. Fine-tuning a non-medical model without further pre-training led to the lowest-performing model. The final model proved stable against variation in the formulations of questions and in dealing with questions on topics excluded from the training set. CONCLUSIONS: General domain BERT models further pre-trained on radiological data achieve high accuracy in answering questions on radiology reports. We propose to integrate our approach into the workflow of medical practitioners and researchers to extract information from radiology reports. CLINICAL RELEVANCE STATEMENT: By reducing the need for manual searches of radiology reports, radiologists' resources are freed up, which indirectly benefits patients. KEY POINTS: ⢠BERT models pre-trained on general domain datasets and radiology reports achieve high accuracy (83.97% F1-score) on question-answering for radiology reports. ⢠The best performing model achieves an F1-score of 83.97% for answerable questions and 96.01% accuracy for questions without an answer. ⢠Additional radiology-specific pretraining of all investigated BERT models improves their performance.
Assuntos
Armazenamento e Recuperação da Informação , Radiologia , Humanos , Idioma , Aprendizado de Máquina , Processamento de Linguagem NaturalRESUMO
Introduction: Perihilar cholangiocarcinoma (PHCC) is a rare malignancy with limited survival prediction accuracy. Artificial intelligence (AI) and digital pathology advancements have shown promise in predicting outcomes in cancer. We aimed to improve prognosis prediction for PHCC by combining AI-based histopathological slide analysis with clinical factors. Methods: We retrospectively analyzed 317 surgically treated PHCC patients (January 2009-December 2018) at the University Hospital of Essen. Clinical data, surgical details, pathology, and outcomes were collected. Convolutional neural networks (CNN) analyzed whole-slide images. Survival models incorporated clinical and histological features. Results: Among 142 eligible patients, independent survival predictors were tumor grade (G), tumor size (T), and intraoperative transfusion requirement. The CNN-based model combining clinical and histopathological features demonstrates proof of concept in prognosis prediction, limited by histopathological complexity and feature extraction challenges. However, the CNN-based model generated heatmaps assisting pathologists in identifying areas of interest. Conclusion: AI-based digital pathology showed potential in PHCC prognosis prediction, though refinement is necessary for clinical relevance. Future research should focus on enhancing AI models and exploring novel approaches to improve PHCC patient prognosis prediction.
RESUMO
BACKGROUND AND OBJECTIVE: We present a novel deep learning-based skull stripping algorithm for magnetic resonance imaging (MRI) that works directly in the information rich complex valued k-space. METHODS: Using four datasets from different institutions with a total of around 200,000 MRI slices, we show that our network can perform skull-stripping on the raw data of MRIs while preserving the phase information which no other skull stripping algorithm is able to work with. For two of the datasets, skull stripping performed by HD-BET (Brain Extraction Tool) in the image domain is used as the ground truth, whereas the third and fourth dataset comes with per-hand annotated brain segmentations. RESULTS: All four datasets were very similar to the ground truth (DICE scores of 92 %-99 % and Hausdorff distances of under 5.5 pixel). Results on slices above the eye-region reach DICE scores of up to 99 %, whereas the accuracy drops in regions around the eyes and below, with partially blurred output. The output of k-Strip often has smoothed edges at the demarcation to the skull. Binary masks are created with an appropriate threshold. CONCLUSION: With this proof-of-concept study, we were able to show the feasibility of working in the k-space frequency domain, preserving phase information, with consistent results. Besides preserving valuable information for further diagnostics, this approach makes an immediate anonymization of patient data possible, already before being transformed into the image domain. Future research should be dedicated to discovering additional ways the k-space can be used for innovative image analysis and further workflows.
Assuntos
Algoritmos , Crânio , Humanos , Crânio/diagnóstico por imagem , Encéfalo/diagnóstico por imagem , Encéfalo/patologia , Processamento de Imagem Assistida por Computador/métodos , Cabeça , Imageamento por Ressonância Magnética/métodosRESUMO
OBJECTIVES: Liver volumetry based on a computed tomography scan is widely used to estimate liver volume before any liver resection, especially before living donorliver donation. The 1-to-1 conversion rule for liver volume to liver weight has been widely adopted; however, debate continues regarding this approach. Therefore, we analyzed the relationship between the left-lateral lobe liver graft volume and actual graft weight. MATERIALS AND METHODS: This study retrospectively included consecutive donors who underwent left lateral hepatectomy for pediatric living donor liver transplant from December 2008 to September 2020. All donors were healthy adults who met the evaluation criteria for pediatric living donor liver transplant and underwent a preoperative contrast-enhanced computed tomography scan. Manual segmentation of the leftlateral liverlobe for graft volume estimation and intraoperative measurement of an actual graft weight were performed. The relationship between estimated graft volume and actual graft weight was analyzed. RESULTS: Ninety-four living liver donors were included in the study. The mean actual graft weight was ~283.4 ± 68.5 g, and the mean graft volume was 244.9 ± 63.86 mL. A strong correlation was shown between graft volume and actual graft weight (r = 0.804; P < .001). Bland-Altman analysis revealed an interobserver agreement of 38.0 ± 97.25, and intraclass correlation coefficient showed almost perfect agreement(r = 0.840; P < .001). The conversion formula for calculating graft weight based on computed tomography volumetry was determined based on regression analysis: 0.88 × graft volume + 41.63. CONCLUSIONS: The estimation of left liver graft weight using only the 1-to-1 rule is subject to measurable variability in calculated graft weights and tends to underestimate the true graft weight. Instead, a different, improved conversion formula should be used to calculate graft weight to more accurately determine donor graft weight-to-recipient body weightratio and reduce the risk of underestimation of liver graft weightin the donor selection process before pediatric living donor liver transplant.
Assuntos
Transplante de Fígado , Adulto , Humanos , Criança , Transplante de Fígado/efeitos adversos , Doadores Vivos , Estudos Retrospectivos , Tamanho do Órgão , Fígado/diagnóstico por imagem , Fígado/cirurgia , Tomografia Computadorizada por Raios XRESUMO
PURPOSE: The study aimed to develop the open-source body and organ analysis (BOA), a comprehensive computed tomography (CT) image segmentation algorithm with a focus on workflow integration. METHODS: The BOA combines 2 segmentation algorithms: body composition analysis (BCA) and TotalSegmentator. The BCA was trained with the nnU-Net framework using a dataset including 300 CT examinations. The CTs were manually annotated with 11 semantic body regions: subcutaneous tissue, muscle, bone, abdominal cavity, thoracic cavity, glands, mediastinum, pericardium, breast implant, brain, and spinal cord. The models were trained using 5-fold cross-validation, and at inference time, an ensemble was used. Afterward, the segmentation efficiency was evaluated on a separate test set comprising 60 CT scans. In a postprocessing step, a tissue segmentation (muscle, subcutaneous adipose tissue, visceral adipose tissue, intermuscular adipose tissue, epicardial adipose tissue, and paracardial adipose tissue) is created by subclassifying the body regions. The BOA combines this algorithm and the open-source segmentation software TotalSegmentator to have an all-in-one comprehensive selection of segmentations. In addition, it integrates into clinical workflows as a DICOM node-triggered service using the open-source Orthanc research PACS (Picture Archiving and Communication System) server to make the automated segmentation algorithms available to clinicians. The BCA model's performance was evaluated using the Sørensen-Dice score. Finally, the segmentations from the 3 different tools (BCA, TotalSegmentator, and BOA) were compared by assessing the overall percentage of the segmented human body on a separate cohort of 150 whole-body CT scans. RESULTS: The results showed that the BCA outperformed the previous publication, achieving a higher Sørensen-Dice score for the previously existing classes, including subcutaneous tissue (0.971 vs 0.962), muscle (0.959 vs 0.933), abdominal cavity (0.983 vs 0.973), thoracic cavity (0.982 vs 0.965), bone (0.961 vs 0.942), and an overall good segmentation efficiency for newly introduced classes: brain (0.985), breast implant (0.943), glands (0.766), mediastinum (0.880), pericardium (0.964), and spinal cord (0.896). All in all, it achieved a 0.935 average Sørensen-Dice score, which is comparable to the one of the TotalSegmentator (0.94). The TotalSegmentator had a mean voxel body coverage of 31% ± 6%, whereas BCA had a coverage of 75% ± 6% and BOA achieved 93% ± 2%. CONCLUSIONS: The open-source BOA merges different segmentation algorithms with a focus on workflow integration through DICOM node integration, offering a comprehensive body segmentation in CT images with a high coverage of the body volume.
RESUMO
OBJECTIVE: Distress assessment of cancer patients is considered state-of-the-art. In addition to distress scores, individual care needs are an important factor for the initiation of psycho-oncological interventions. In a mono-centric, observational study, we aimed for characterization of patients indicating a subjective need but declining to utilize support services immediately to facilitate implementation of adapted screenings. METHODS: This study analyzed retrospective data from routine distress screening and associated data from hospital records. Descriptive, variance and regression analyses were used to assess characteristics of postponed support utilization in patients with mixed cancer diagnoses in different treatment settings. RESULTS: Of the total sample (N = 1863), 13% indicated a subjective need but postponed support utilization. This subgroup presented as being as burdened by symptoms of depression (p < 0.001), anxiety (p < 0.001) and distress (p < 0.001) as subjectively distressed patients with intent to directly utilize support. Time periods since diagnosis were shorter (p = 0.007) and patients were more often inpatients (p = 0.045). CONCLUSIONS: Despite high heterogeneity among the subgroups, this study identified distress-related factors and time since diagnosis as possible predictors for postponed utilization of psycho-oncological interventions. Results suggest the necessity for time-individualized support which may improve utilization by distressed patients.