RESUMEN
BACKGROUND AND PURPOSE: Symptoms of normal pressure hydrocephalus (NPH) are sometimes refractory to shunt placement, with limited ability to predict improvement for individual patients. We evaluated an MRI-based artificial intelligence method to predict post-shunt NPH symptom improvement. MATERIALS AND METHODS: NPH patients who underwent magnetic resonance imaging (MRI) prior to shunt placement at a single center (2014-2021) were identified. Twelve-month post-shunt improvement in modified Rankin Scale (mRS), incontinence, gait, and cognition were retrospectively abstracted from clinical documentation. 3D deep residual neural networks were built on skull stripped T2-weighted and fluid attenuated inversion recovery (FLAIR) images. Predictions based on both sequences were fused by additional network layers. Patients from 2014-2019 were used for parameter optimization, while those from 2020-2021 were used for testing. Models were validated on an external validation dataset from a second institution (n=33). RESULTS: Of 249 patients, n=201 and n=185 were included in the T2-based and FLAIR-based models according to imaging availability. The combination of T2-weighted and FLAIR sequences offered the best performance in mRS and gait improvement predictions relative to models trained on imaging acquired using only one sequence, with AUROC values of 0.7395 [0.5765-0.9024] for mRS and 0.8816 [0.8030-0.9602] for gait. For urinary incontinence and cognition, combined model performances on predicting outcomes were similar to FLAIR-only performance, with AUROC values of 0.7874 [0.6845-0.8903] and 0.7230 [0.5600-0.8859]. CONCLUSIONS: Application of a combined algorithm using both T2-weighted and FLAIR sequences offered the best image-based prediction of post-shunt symptom improvement, particularly for gait and overall function in terms of mRS. ABBREVIATIONS: NPH = normal pressure hydrocephalus; iNPH = idiopathic NPH; sNPH = secondary NPH; AI = artificial intelligence; ML = machine learning; CSF = cerebrospinal fluid; AUROC = area under the receiver operating characteristic; FLAIR = fluid attenuated inversion recovery; BMI = body mass index; CCI = Charlson Comorbidity Index; SD = standard deviation; IQR = interquartile range.
RESUMEN
Purpose: The purpose of this study is to identify clinical and imaging characteristics associated with post-COVID pulmonary function decline. Methods: This study included 22 patients recovering from COVID-19 who underwent serial spirometry pulmonary function testing (PFT) before and after diagnosis. Patients were divided into two cohorts by difference between baseline and post-COVID follow-up PFT: Decline group (>10 % decrease in FEV1), and Stable group (≤10 % decrease or improvement in FEV1). Demographic, clinical, and laboratory data were collected, as well as PFT and chest computed tomography (CT) at the time of COVID diagnosis and follow-up. CTs were semi-quantitatively scored on a five-point severity scale for disease extent in each lobe by two radiologists. Mann-Whitney U-tests, T-tests, and Chi-Squared tests were used for comparison. P-values <0.05 were considered statistically significant. Results: The Decline group had a higher proportion of neutrophils (79.47 ± 4.83 % vs. 65.45 ± 10.22 %; p = 0.003), a higher absolute neutrophil count (5.73 ± 2.68 × 109/L vs. 3.43 ± 1.74 × 109/L; p = 0.031), and a lower proportion of lymphocytes (9.90 ± 4.20 % vs. 21.21 ± 10.97 %; p = 0.018) compared to the Stable group. The Decline group also had significantly higher involvement of ground-glass opacities (GGO) on follow-up chest CT [8.50 (4.50, 14.50) vs. 3.0 (1.50, 9.50); p = 0.032] and significantly higher extent of reticulations on chest CT at time of COVID diagnosis [6.50 (4.00, 9.00) vs. 2.00 (0.00, 6.00); p = 0.039] and follow-up [5.00 (3.00, 13.00) vs. 2.00 (0.00, 5.00); p = 0.041]. ICU admission was higher in the Decline group than in the Stable group (71.4 % vs. 13.3 %; p = 0.014). Conclusions: This study provides novel insight into factors influencing post-COVID lung function, irrespective of pre-existing pulmonary conditions. Our findings underscore the significance of neutrophil counts, reduced lymphocyte counts, pulmonary reticulation on chest CT at diagnosis, and extent of GGOs on follow-up chest CT as potential indicators of decreased post-COVID lung function. This knowledge may guide prediction and further understanding of long-term sequelae of COVID-19 infection.
RESUMEN
In response to the worldwide COVID-19 pandemic, advanced automated technologies have emerged as valuable tools to aid healthcare professionals in managing an increased workload by improving radiology report generation and prognostic analysis. This study proposes a Multi-modality Regional Alignment Network (MRANet), an explainable model for radiology report generation and survival prediction that focuses on high-risk regions. By learning spatial correlation in the detector, MRANet visually grounds region-specific descriptions, providing robust anatomical regions with a completion strategy. The visual features of each region are embedded using a novel survival attention mechanism, offering spatially and risk-aware features for sentence encoding while maintaining global coherence across tasks. A cross-domain LLMs-Alignment is employed to enhance the image-to-text transfer process, resulting in sentences rich with clinical detail and improved explainability for radiologists. Multi-center experiments validate the overall performance and each module's composition within the model, encouraging further advancements in radiology report generation research emphasizing clinical interpretation and trustworthiness in AI models applied to medical studies.
RESUMEN
Uptake segmentation and classification on PSMA PET/CT are important for automating whole-body tumor burden determinations. We developed and evaluated an automated deep learning (DL)-based framework that segments and classifies uptake on PSMA PET/CT. We identified 193 [18F] DCFPyL PET/CT scans of patients with biochemically recurrent prostate cancer from two institutions, including 137 [18F] DCFPyL PET/CT scans for training and internally testing, and 56 scans from another institution for external testing. Two radiologists segmented and labelled foci as suspicious or non-suspicious for malignancy. A DL-based segmentation was developed with two independent CNNs. An anatomical prior guidance was applied to make the DL framework focus on PSMA-avid lesions. Segmentation performance was evaluated by Dice, IoU, precision, and recall. Classification model was constructed with multi-modal decision fusion framework evaluated by accuracy, AUC, F1 score, precision, and recall. Automatic segmentation of suspicious lesions was improved under prior guidance, with mean Dice, IoU, precision, and recall of 0.700, 0.566, 0.809, and 0.660 on the internal test set and 0.680, 0.548, 0.749, and 0.740 on the external test set. Our multi-modal decision fusion framework outperformed single-modal and multi-modal CNNs with accuracy, AUC, F1 score, precision, and recall of 0.764, 0.863, 0.844, 0.841, and 0.847 in distinguishing suspicious and non-suspicious foci on the internal test set and 0.796, 0.851, 0.865, 0.814, and 0.923 on the external test set. DL-based lesion segmentation on PSMA PET is facilitated through our anatomical prior guidance strategy. Our classification framework differentiates suspicious foci from those not suspicious for cancer with good accuracy.
RESUMEN
Health disparities among marginalized populations with lower socioeconomic status significantly impact the fairness and effectiveness of healthcare delivery. The increasing integration of artificial intelligence (AI) into healthcare presents an opportunity to address these inequalities, provided that AI models are free from bias. This paper aims to address the bias challenges by population disparities within healthcare systems, existing in the presentation of and development of algorithms, leading to inequitable medical implementation for conditions such as pulmonary embolism (PE) prognosis. In this study, we explore the diverse bias in healthcare systems, which highlights the demand for a holistic framework to reducing bias by complementary aggregation. By leveraging de-biasing deep survival prediction models, we propose a framework that disentangles identifiable information from images, text reports, and clinical variables to mitigate potential biases within multimodal datasets. Our study offers several advantages over traditional clinical-based survival prediction methods, including richer survival-related characteristics and bias-complementary predicted results. By improving the robustness of survival analysis through this framework, we aim to benefit patients, clinicians, and researchers by enhancing fairness and accuracy in healthcare AI systems.
Asunto(s)
Algoritmos , Embolia Pulmonar , Humanos , Embolia Pulmonar/mortalidad , Análisis de Supervivencia , Femenino , Masculino , Persona de Mediana Edad , Anciano , Pronóstico , Bases de Datos FactualesRESUMEN
Deep learning models have demonstrated great potential in medical imaging but are limited by the expensive, large volume of annotations required. To address this, we compared different active learning strategies by training models on subsets of the most informative images using real-world clinical datasets for brain tumor segmentation and proposing a framework that minimizes the data needed while maintaining performance. Then, 638 multi-institutional brain tumor magnetic resonance imaging scans were used to train three-dimensional U-net models and compare active learning strategies. Uncertainty estimation techniques including Bayesian estimation with dropout, bootstrapping, and margins sampling were compared to random query. Strategies to avoid annotating similar images were also considered. We determined the minimum data necessary to achieve performance equivalent to the model trained on the full dataset (α = 0.05). Bayesian approximation with dropout at training and testing showed results equivalent to that of the full data model (target) with around 30% of the training data needed by random query to achieve target performance (p = 0.018). Annotation redundancy restriction techniques can reduce the training data needed by random query to achieve target performance by 20%. We investigated various active learning strategies to minimize the annotation burden for three-dimensional brain tumor segmentation. Dropout uncertainty estimation achieved target performance with the least annotated data.
RESUMEN
This rapid communication highlights the correlations between digital pathology-whole slide imaging (WSI) and radiomics-magnetic resonance imaging (MRI) features in triple-negative breast cancer (TNBC) patients. The research collected 12 patients who had both core needle biopsy and MRI performed to evaluate pathologic complete response (pCR). The results showed that higher collagenous values in pathology data were correlated with more homogeneity, whereas higher tumor expression values in pathology data correlated with less homogeneity in the appearance of tumors on MRI by size zone non-uniformity normalized (SZNN). Higher myxoid values in pathology data are correlated with less similarity of gray-level non-uniformity (GLN) in tumor regions on MRIs, while higher immune values in WSIs correlated with the more joint distribution of smaller-size zones by small area low gray-level emphasis (SALGE) in the tumor regions on MRIs. Pathologic complete response (pCR) was associated with collagen, tumor, and myxoid expression in WSI and GLN and SZNN in radiomic features. The correlations of WSI and radiomic features may further our understanding of the TNBC tumoral microenvironment (TME) and could be used in the future to better tailor the use of neoadjuvant chemotherapy (NAC). This communication will focus on the post-NAC MRI features correlated with pCR and their association with WSI features from core needle biopsies.
Asunto(s)
Imagen por Resonancia Magnética , Neoplasias de la Mama Triple Negativas , Humanos , Neoplasias de la Mama Triple Negativas/diagnóstico por imagen , Neoplasias de la Mama Triple Negativas/patología , Femenino , Imagen por Resonancia Magnética/métodos , Biopsia con Aguja Gruesa/métodos , Persona de Mediana Edad , Adulto , Anciano , Microambiente Tumoral , Terapia Neoadyuvante/métodos , Respuesta Patológica Completa , RadiómicaRESUMEN
T1 image is a widely collected imaging sequence in various neuroimaging datasets, but it is rarely used to construct an individual-level brain network. In this study, a novel individualized radiomics-based structural similarity network was proposed from T1 images. In detail, it used voxel-based morphometry to obtain the preprocessed gray matter images, and radiomic features were then extracted on each region of interest in Brainnetome atlas, and an individualized radiomics-based structural similarity network was finally built using the correlational values of radiomic features between any pair of regions of interest. After that, the network characteristics of individualized radiomics-based structural similarity network were assessed, including graph theory attributes, test-retest reliability, and individual identification ability (fingerprinting). At last, two representative applications for individualized radiomics-based structural similarity network, namely mild cognitive impairment subtype discrimination and fluid intelligence prediction, were exemplified and compared with some other networks on large open-source datasets. The results revealed that the individualized radiomics-based structural similarity network displays remarkable network characteristics and exhibits advantageous performances in mild cognitive impairment subtype discrimination and fluid intelligence prediction. In summary, the individualized radiomics-based structural similarity network provides a distinctive, reliable, and informative individualized structural brain network, which can be combined with other networks such as resting-state functional connectivity for various phenotypic and clinical applications.
Asunto(s)
Encéfalo , Radiómica , Reproducibilidad de los Resultados , Encéfalo/diagnóstico por imagen , Sustancia Gris/diagnóstico por imagen , NeuroimagenRESUMEN
Semi-supervised learning methods have been explored to mitigate the scarcity of pixel-level annotation in medical image segmentation tasks. Consistency learning, serving as a mainstream method in semi-supervised training, suffers from low efficiency and poor stability due to inaccurate supervision and insufficient feature representation. Prototypical learning is one potential and plausible way to handle this problem due to the nature of feature aggregation in prototype calculation. However, the previous works have not fully studied how to enhance the supervision quality and feature representation using prototypical learning under the semi-supervised condition. To address this issue, we propose an implicit-explicit alignment (IEPAlign) framework to foster semi-supervised consistency training. In specific, we develop an implicit prototype alignment method based on dynamic multiple prototypes on-the-fly. And then, we design a multiple prediction voting strategy for reliable unlabeled mask generation and prototype calculation to improve the supervision quality. Afterward, to boost the intra-class consistency and inter-class separability of pixel-wise features in semi-supervised segmentation, we construct a region-aware hierarchical prototype alignment, which transmits information from labeled to unlabeled and from certain regions to uncertain regions. We evaluate IEPAlign on three medical image segmentation tasks. The extensive experimental results demonstrate that the proposed method outperforms other popular semi-supervised segmentation methods and achieves comparable performance with fully-supervised training methods.
Asunto(s)
Aprendizaje Automático Supervisado , Votación , Procesamiento de Imagen Asistido por ComputadorRESUMEN
BACKGROUND: Diagnosis and treatment management for head and neck squamous cell carcinoma (HNSCC) is guided by routine diagnostic head and neck computed tomography (CT) scans to identify tumor and lymph node features. The extracapsular extension (ECE) is a strong predictor of patients' survival outcomes with HNSCC. It is essential to detect the occurrence of ECE as it changes staging and treatment planning for patients. Current clinical ECE detection relies on visual identification and pathologic confirmation conducted by clinicians. However, manual annotation of the lymph node region is a required data preprocessing step in most of the current machine learning-based ECE diagnosis studies. PURPOSE: In this paper, we propose a Gradient Mapping Guided Explainable Network (GMGENet) framework to perform ECE identification automatically without requiring annotated lymph node region information. METHODS: The gradient-weighted class activation mapping (Grad-CAM) technique is applied to guide the deep learning algorithm to focus on the regions that are highly related to ECE. The proposed framework includes an extractor and a classifier. In a joint training process, informative volumes of interest (VOIs) are extracted by the extractor without labeled lymph node region information, and the classifier learns the pattern to classify the extracted VOIs into ECE positive and negative. RESULTS: In evaluation, the proposed methods are well-trained and tested using cross-validation. GMGENet achieved test accuracy and area under the curve (AUC) of 92.2% and 89.3%, respectively. GMGENetV2 achieved 90.3% accuracy and 91.7% AUC in the test. The results were compared with different existing models and further confirmed and explained by generating ECE probability heatmaps via a Grad-CAM technique. The presence or absence of ECE has been analyzed and correlated with ground truth histopathological findings. CONCLUSIONS: The proposed deep network can learn meaningful patterns to identify ECE without providing lymph node contours. The introduced ECE heatmaps will contribute to the clinical implementations of the proposed model and reveal unknown features to radiologists. The outcome of this study is expected to promote the implementation of explainable artificial intelligence-assiste ECE detection.
Asunto(s)
Extensión Extranodal , Neoplasias de Cabeza y Cuello , Humanos , Carcinoma de Células Escamosas de Cabeza y Cuello , Extensión Extranodal/patología , Inteligencia Artificial , Neoplasias de Cabeza y Cuello/diagnóstico por imagen , Neoplasias de Cabeza y Cuello/patología , Ganglios Linfáticos/diagnóstico por imagen , Ganglios Linfáticos/patología , Tomografía Computarizada por Rayos X , Redes Neurales de la ComputaciónRESUMEN
Interventional oncology is a rapidly growing field with advances in minimally invasive image-guided local-regional treatments for hepatocellular carcinoma (HCC), including transarterial chemoembolization, transarterial radioembolization, and thermal ablation. However, current standardized clinical staging systems for HCC are limited in their ability to optimize patient selection for treatment as they rely primarily on serum markers and radiologist-defined imaging features. Given the variation in treatment responses, an updated scoring system that includes multidimensional aspects of the disease, including quantitative imaging features, serum markers, and functional biomarkers, is needed to optimally triage patients. With the vast amounts of numerical medical record data and imaging features, researchers have turned to image-based methods, such as radiomics and artificial intelligence (AI), to automatically extract and process multidimensional data from images. The synthesis of these data can provide clinically relevant results to guide personalized treatment plans and optimize resource utilization. Machine learning (ML) is a branch of AI in which a model learns from training data and makes effective predictions by teaching itself. This review article outlines the basics of ML and provides a comprehensive overview of its potential value in the prediction of treatment response in patients with HCC after minimally invasive image-guided therapy.
Asunto(s)
Carcinoma Hepatocelular , Quimioembolización Terapéutica , Neoplasias Hepáticas , Humanos , Inteligencia Artificial , Aprendizaje Automático , BiomarcadoresRESUMEN
We develop deep clustering survival machines to simultaneously predict survival information and characterize data heterogeneity that is not typically modeled by conventional survival analysis methods. By modeling timing information of survival data generatively with a mixture of parametric distributions, referred to as expert distributions, our method learns weights of the expert distributions for individual instances based on their features discriminatively such that each instance's survival information can be characterized by a weighted combination of the learned expert distributions. Extensive experiments on both real and synthetic datasets have demonstrated that our method is capable of obtaining promising clustering results and competitive time-to-event predicting performance.
RESUMEN
PURPOSE: The study was aimed to develop and evaluate a deep learning-based radiomics to predict the histological risk categorization of thymic epithelial tumors (TETs), which can be highly informative for patient treatment planning and prognostic assessment. METHOD: A total of 681 patients with TETs from three independent hospitals were included and separated into derivation cohort and external test cohort. Handcrafted and deep learning features were extracted from preoperative contrast-enhanced CT images and selected to build three radiomics signatures (radiomics signature [Rad_Sig], deep learning signature [DL_Sig] and deep learning radiomics signature [DLR_Sig]) to predict risk categorization of TETs. A deep learning-based radiomic nomogram (DLRN) was then depicted to visualize the classification evaluation. The performance of predictive models was compared using the receiver operating characteristic and decision curve analysis (DCA). RESULTS: Among three radiomics signatures, DLR_Sig demonstrated optimum performance with an AUC of 0.883 for the derivation cohort and 0.749 for the external test cohort. Combining DLR_Sig with age and gender, DLRN was depict and exhibited optimum performance among all radiomics models with an AUC of 0.965, accuracy of 0.911, sensitivity of 0.921 and specificity of 0.902 in the derivation cohort, and an AUC of 0.786, accuracy of 0.774, sensitivity of 0.778 and specificity of 0.771 in the external test cohort. The DCA showed that DLRN had greater clinical benefit than other radiomics signatures. CONCLUSIONS: Our study developed and validated a DLRN to accurately predict the risk categorization of TETs, which has potential to facilitate individualized treatment and improve patient prognosis evaluation.
Asunto(s)
Aprendizaje Profundo , Neoplasias Glandulares y Epiteliales , Neoplasias del Timo , Humanos , Nomogramas , Neoplasias Glandulares y Epiteliales/diagnóstico por imagen , Neoplasias del Timo/diagnóstico por imagen , Estudios RetrospectivosRESUMEN
Reconstructing visual experience from brain responses measured by functional magnetic resonance imaging (fMRI) is a challenging yet important research topic in brain decoding, especially it has proved more difficult to decode visually similar stimuli, such as faces. Although face attributes are known as the key to face recognition, most existing methods generally ignore how to decode facial attributes more precisely in perceived face reconstruction, which often leads to indistinguishable reconstructed faces. To solve this problem, we propose a novel neural decoding framework called VSPnet (voxel2style2pixel) by establishing hierarchical encoding and decoding networks with disentangled latent representations as media, so that to recover visual stimuli more elaborately. And we design a hierarchical visual encoder (named HVE) to pre-extract features containing both high-level semantic knowledge and low-level visual details from stimuli. The proposed VSPnet consists of two networks: Multi-branch cognitive encoder and style-based image generator. The encoder network is constructed by multiple linear regression branches to map brain signals to the latent space provided by the pre-extracted visual features and obtain representations containing hierarchical information consistent to the corresponding stimuli. We make the generator network inspired by StyleGAN to untangle the complexity of fMRI representations and generate images. And the HVE network is composed of a standard feature pyramid over a ResNet backbone. Extensive experimental results on the latest public datasets have demonstrated the reconstruction accuracy of our proposed method outperforms the state-of-the-art approaches and the identifiability of different reconstructed faces has been greatly improved. In particular, we achieve feature editing for several facial attributes in fMRI domain based on the multiview (i.e., visual stimuli and evoked fMRI) latent representations.
Asunto(s)
Encéfalo , Reconocimiento en Psicología , Encéfalo/diagnóstico por imagen , Encéfalo/fisiología , Mapeo Encefálico/métodos , Imagen por Resonancia Magnética/métodos , Análisis MultivarianteRESUMEN
Breast cancer is a leading cause of death for women globally. A characteristic of breast cancer includes its ability to metastasize to distant regions of the body, and the disease achieves this through first spreading to the axillary lymph nodes. Traditional diagnosis of axillary lymph node metastasis includes an invasive technique that leads to potential clinical complications for breast cancer patients. The rise of artificial intelligence in the medical imaging field has led to the creation of innovative deep learning models that can predict the metastatic status of axillary lymph nodes noninvasively, which would result in no unnecessary biopsies and dissections for patients. In this review, we discuss the success of various deep learning artificial intelligence models across multiple imaging modalities in their performance of predicting axillary lymph node metastasis.
RESUMEN
Deep convolutional neural networks (DCNNs) have shown promise in brain tumor segmentation from multi-modal MRI sequences, accommodating heterogeneity in tumor shape and appearance. The fusion of multiple MRI sequences allows networks to explore complementary tumor information for segmentation. However, developing a network that maintains clinical relevance in situations where certain MRI sequence(s) might be unavailable or unusual poses a significant challenge. While one solution is to train multiple models with different MRI sequence combinations, it is impractical to train every model from all possible sequence combinations. In this paper, we propose a DCNN-based brain tumor segmentation framework incorporating a novel sequence dropout technique in which networks are trained to be robust to missing MRI sequences while employing all other available sequences. Experiments were performed on the RSNA-ASNR-MICCAI BraTS 2021 Challenge dataset. When all MRI sequences were available, there were no significant differences in performance of the model with and without dropout for enhanced tumor (ET), tumor (TC), and whole tumor (WT) (p-values 1.000, 1.000, 0.799, respectively), demonstrating that the addition of dropout improves robustness without hindering overall performance. When key sequences were unavailable, the network with sequence dropout performed significantly better. For example, when tested on only T1, T2, and FLAIR sequences together, DSC for ET, TC, and WT increased from 0.143 to 0.486, 0.431 to 0.680, and 0.854 to 0.901, respectively. Sequence dropout represents a relatively simple yet effective approach for brain tumor segmentation with missing MRI sequences.
Asunto(s)
Neoplasias Encefálicas , Procesamiento de Imagen Asistido por Computador , Humanos , Procesamiento de Imagen Asistido por Computador/métodos , Neoplasias Encefálicas/diagnóstico por imagen , Neoplasias Encefálicas/patología , Redes Neurales de la Computación , Imagen por Resonancia Magnética/métodosRESUMEN
Segmentation of liver from CT scans is essential in computer-aided liver disease diagnosis and treatment. However, the 2DCNN ignores the 3D context, and the 3DCNN suffers from numerous learnable parameters and high computational cost. In order to overcome this limitation, we propose an Attentive Context-Enhanced Network (AC-E Network) consisting of 1) an attentive context encoding module (ACEM) that can be integrated into the 2D backbone to extract 3D context without a sharp increase in the number of learnable parameters; 2) a dual segmentation branch including complemental loss making the network attend to both the liver region and boundary so that getting the segmented liver surface with high accuracy. Extensive experiments on the LiTS and the 3D-IRCADb datasets demonstrate that our method outperforms existing approaches and is competitive to the state-of-the-art 2D-3D hybrid method on the equilibrium of the segmentation precision and the number of model parameters.
Asunto(s)
Abdomen , Neoplasias Hepáticas , Humanos , Tomografía Computarizada por Rayos X/métodos , Diagnóstico por Computador , Procesamiento de Imagen Asistido por Computador/métodosRESUMEN
Objective. Radiation therapy for head and neck (H&N) cancer relies on accurate segmentation of the primary tumor. A robust, accurate, and automated gross tumor volume segmentation method is warranted for H&N cancer therapeutic management. The purpose of this study is to develop a novel deep learning segmentation model for H&N cancer based on independent and combined CT and FDG-PET modalities.Approach. In this study, we developed a robust deep learning-based model leveraging information from both CT and PET. We implemented a 3D U-Net architecture with 5 levels of encoding and decoding, computing model loss through deep supervision. We used a channel dropout technique to emulate different combinations of input modalities. This technique prevents potential performance issues when only one modality is available, increasing model robustness. We implemented ensemble modeling by combining two types of convolutions with differing receptive fields, conventional and dilated, to improve capture of both fine details and global information.Main Results. Our proposed methods yielded promising results, with a Dice similarity coefficient (DSC) of 0.802 when deployed on combined CT and PET, DSC of 0.610 when deployed on CT, and DSC of 0.750 when deployed on PET.Significance. Application of a channel dropout method allowed for a single model to achieve high performance when deployed on either single modality images (CT or PET) or combined modality images (CT and PET). The presented segmentation techniques are clinically relevant to applications where images from a certain modality might not always be available.
Asunto(s)
Aprendizaje Profundo , Neoplasias de Cabeza y Cuello , Humanos , Tomografía Computarizada por Tomografía de Emisión de Positrones/métodos , Tomografía Computarizada por Rayos X , Redes Neurales de la Computación , Procesamiento de Imagen Asistido por Computador/métodosRESUMEN
BACKGROUND: Hematologic toxicity (HT) is a common adverse tissue reaction during radiotherapy for rectal cancer patients, which may lead to various negative effects such as reduced therapeutic effect, prolonged treatment period and increased treatment cost. Therefore, predicting the occurrence of HT before radiotherapy is necessary but still challenging. PURPOSE: This study proposes a hybrid machine learning model to predict the symptomatic radiation HT in rectal cancer patients using the combined demographic, clinical, dosimetric, and Radiomics features, and ascertains the most effective regions of interest (ROI) in CT images and predictive feature sets. METHODS: A discovery dataset of 240 rectal cancer patients, including 145 patients with HT symptoms and a validation dataset of 96 patients (63 patients with HT) with different dose prescription were retrospectively enrolled. Eight ROIs were contoured on patient CT images to derive Radiomics features, which were then, respectively, combined with the demographic, clinical, and dosimetric features to classify patients with HT symptoms. Moreover, the survival analysis was performed on risky patients with HT in order to understand the HT progression. RESULTS: The classification models in ROIs of bone marrow and femoral head exhibited relatively high accuracies (accuracy = 0.765 and 0.725) in the discovery dataset as well as comparable performances in the validation dataset (accuracy = 0.758 and 0.714). When combining the two ROIs together, the model performance was the best in both discovery and validation datasets (accuracy = 0.843 and 0.802). In the survival analysis test, only the bone marrow ROI achieved statistically significant performance in accessing risky HT (C-index = 0.658, P = 0.03). Most of the discriminative features were Radiomics features, and only gender and the mean dose in Irradvolume was involved in HT. CONCLUSION: The results reflect that the Radiomics features of bone marrow are significantly correlated with HT occurrence and progression in rectal cancer. The proposed Radiomics-based model may help the early detection of radiotherapy induced HT in rectal cancer patients and thus improve the clinical outcome in future.
Asunto(s)
Traumatismos por Radiación , Neoplasias del Recto , Humanos , Estudios Retrospectivos , Detección Precoz del Cáncer , Recto , Neoplasias del Recto/diagnóstico por imagen , Neoplasias del Recto/radioterapia , Traumatismos por Radiación/diagnóstico por imagen , Traumatismos por Radiación/etiologíaRESUMEN
Camouflaged object detection, which aims to detect/segment the object(s) that blend in with their surrounding, remains challenging for deep models due to the intrinsic similarities between foreground objects and background surroundings. Ideally, an effective model should be capable of finding valuable clues from the given scene and integrating them into a joint learning framework to co-enhance the representation. Inspired by this observation, we propose a novel Mutual Graph Learning (MGL) model by shifting the conventional perspective of mutual learning from regular grids to graph domain. Specifically, an image is decoupled by MGL into two task-specific feature maps - one for finding the rough location of the target and the other for capturing its accurate boundary details. Then, the mutual benefits can be fully exploited by reasoning their high-order relations through graphs recurrently. It should be noted that our method is different from most mutual learning models that model all between-task interactions with the use of a shared function. To increase information interactions, MGL is built with typed functions for dealing with different complementary relations. To overcome the accuracy loss caused by interpolation to higher resolution and the computational redundancy resulting from recurrent learning, the S-MGL is equipped with a multi-source attention contextual recovery module, called R-MGL_v2, which uses the pixel feature information iteratively. Experiments on challenging datasets, including CHAMELEON, CAMO, COD10K, and NC4K demonstrate the effectiveness of our MGL with superior performance to existing state-of-the-art methods. The code can be found at https://github.com/fanyang587/MGL.