RÉSUMÉ
Esophageal cancer is a common malignant tumor, precisely predicting survival of esophageal cancer is crucial for personalized treatment. However, current region of interest (ROI) based methodologies not only necessitate prior medical knowledge for tumor delineation, but may also cause the model to be overly sensitive to ROI. To address these challenges, we develop an automated Hybrid Transformer based learning that integrates a Hybrid Transformer size-aware U-Net with a ranked survival prediction network to enable automatic survival prediction for esophageal cancer. Specifically, we first incorporate the Transformer with shifted windowing multi-head self-attention mechanism (SW-MSA) into the base of the UNet encoder to capture the long-range dependency in CT images. Furthermore, to alleviate the imbalance between the ROI and the background in CT images, we devise a size-aware coefficient for the segmentation loss. Finally, we also design a ranked pair sorting loss to more comprehensively capture the ranked information inherent in CT images. We evaluate our proposed method on a dataset comprising 759 samples with esophageal cancer. Experimental results demonstrate the superior performance of our proposed method in survival prediction, even without ROI ground truth.
RÉSUMÉ
Chinese electronic medical records (EMR) presents significant challenges for named entity recognition (NER) due to their specialized nature, unique language features, and diverse expressions. Traditionally, NER is treated as a sequence labeling task, where each token is assigned a label. Recent research has reframed NER within the machine reading comprehension (MRC) framework, extracting entities in a question-answer format, achieving state-of-the-art performance. However, these MRC-based methods have a significant limitation: they extract entities of various types independently, ignoring their interrelations. To address this, we introduce the Fusion Label Relations with MRC (FLR-MRC) model, which enhances the MRC model by implicitly capturing dependencies among entity types. FLR-MRC models interrelations between labels using graph attention networks, integrating these with textual data to identify entities. On the benchmark CMeEE and CCKS2017-CNER datasets, FLR-MRC achieves F1-scores of 0.6652 and 0.9101, respectively, outperforming existing clinical NER methods.
RÉSUMÉ
BACKGROUND: To develop a radiomics model based on chest computed tomography (CT) for the prediction of a pathological complete response (pCR) after neoadjuvant or conversion chemoimmunotherapy (CIT) in patients with non-small cell lung cancer (NSCLC). METHODS: Patients with stage IB-III NSCLC who received neoadjuvant or conversion CIT between September 2019 and July 2021 at Hunan Cancer Hospital, Xiangya Hospital, and Union Hospital were retrospectively collected. The least absolute shrinkage and selection operator (LASSO) were used to screen features. Then, model 1 (five radiomics features before CIT), model 2 (four radiomics features after CIT and before surgery) and model 3 were constructed for the prediction of pCR. Model 3 included all nine features of model 1 and 2 and was later named the neoadjuvant chemoimmunotherapy-related pathological response prediction model (NACIP). RESULTS: This study included 110 patients: 77 in the training set and 33 in the validation set. Thirty-nine (35.5%) patients achieved a pCR. Model 1 showed area under the curve (AUC) = 0.65, 64% accuracy, 71% specificity, and 50% sensitivity, while model 2 displayed AUC = 0.81, 73% accuracy, 62% specificity, and 92% sensitivity. In comparison, NACIP yielded a good predictive value, with an AUC of 0.85, 81% accuracy, 81% specificity, and 83% sensitivity in the validation set. CONCLUSION: NACIP may be a potential model for the early prediction of pCR in patients with NSCLC treated with neoadjuvant/conversion CIT.
Sujet(s)
Carcinome pulmonaire non à petites cellules , Tumeurs du poumon , Humains , Carcinome pulmonaire non à petites cellules/imagerie diagnostique , Carcinome pulmonaire non à petites cellules/traitement médicamenteux , Tumeurs du poumon/imagerie diagnostique , Tumeurs du poumon/traitement médicamenteux , Traitement néoadjuvant , Études rétrospectives , Aire sous la courbeRÉSUMÉ
Hippocampus has great influence over the Alzheimer's disease (AD) research because of its essential role as a biomarker in the human brain. Thus the performance of hippocampus segmentation influences the development of clinical research for brain disorders. Deep learning using U-net-like networks becomes prevalent in hippocampus segmentation on Magnetic Resonance Imaging (MRI) due to its efficiency and accuracy. However, current methods lose sufficient detailed information during pooling, which hinders the segmentation results. And weak supervision on the details like edges or positions results in fuzzy and coarse boundary segmentation, causing great differences between the segmentation and ground-truth. In view of these drawbacks, we propose a Region-Boundary and Structure Net (RBS-Net), which consists of a primary net and an auxiliary net. (1) Our primary net focuses on the region distribution of hippocampus and introduces a distance map for boundary supervision. Furthermore the primary net adds a multi-layer feature learning module to compensate the information loss during pooling and strengthen the differences between the foreground and background, improving the region and boundary segmentation. (2) The auxiliary net concentrates on the structure similarity and also utilizes the multi-layer feature learning module, and this parallel task can refine encoders by similarizing the structure of the segmentation and ground-truth. We train and test our network using 5-fold cross-validation on HarP, a public available hippocampus dataset. Experimental results demonstrate that our proposed RBS-Net achieves a Dice of 89.76% in average, outperforming several state-of-the-art hippocampus segmentation methods. Furthermore, in few shot circumstances, our proposed RBS-Net achieves better results in terms of a comprehensive evaluation compared to several state-of-the-art deep learning-based methods. Finally we can observe that visual segmentation results for the boundary and detailed regions are improved by our proposed RBS-Net.
Sujet(s)
Maladie d'Alzheimer , Traitement d'image par ordinateur , Humains , Traitement d'image par ordinateur/méthodes , Imagerie par résonance magnétique/méthodes , Encéphale , Hippocampe/imagerie diagnostique , Maladie d'Alzheimer/imagerie diagnostiqueRÉSUMÉ
In recent years, deep learning as a state-of-the-art machine learning technique has made great success in histopathological image classification. However, most of deep learning approaches rely heavily on the substantial task-specific annotations, which require experienced pathologists' manual labelling. As a result, they are laborious and time-consuming, and many unlabeled pathological images are difficult to use without experts' annotations. To mitigate the requirement for data annotation, we propose a self-supervised Deep Adaptive Regularized Clustering (DARC) framework to pre-train a neural network. DARC iteratively clusters the learned representations and utilizes the cluster assignments as pseudo-labels to learn the parameters of the network. To learn feasible representations and encourage the representations to become more discriminative, we design an objective function combining a network loss with a clustering loss using an adaptive regularization function, which is updated adaptively throughout the training process to learn feasible representations. The proposed DARC is evaluated on three public datasets, including NCT-CRC-HE-100K, PCam and LC25000. Compared to the strategy of training from scratch, fine-tuning using the pre-trained weights of DARC can obviously boost the accuracy of neural networks on histopathological classification. The accuracy of using the network trained using DARC pre-trained weights with only 10% labeled data is already comparable to the network trained from scratch with 100% training data. The network using DARC pre-trained weights achieves the fastest convergence speed on the downstream classification task. Moreover, visualization through t-distributed stochastic neighbor embedding (t-SNE) shows that the learned representations are generalizable and discriminative.
Sujet(s)
Apprentissage machine , , Algorithmes , Analyse de regroupements , HumainsRÉSUMÉ
Accurate prediction of pathological complete response (pCR) after neoadjuvant chemoradiotherapy (nCRT) is essential for clinical precision treatment. However, the existing methods of predicting pCR in esophageal cancer are based on the single stage data, which limits the performance of these methods. Effective fusion of the longitudinal data has the potential to improve the performance of pCR prediction, thanks to the combination of complementary information. In this study, we propose a new multi-loss disentangled representation learning (MLDRL) to realize the effective fusion of complementary information in the longitudinal data. Specifically, we first disentangle the latent variables of features in each stage into inherent and variational components. Then, we define a multi-loss function to ensure the effectiveness and structure of disentanglement, which consists of a cross-cycle reconstruction loss, an inherent-variational loss and a supervised classification loss. Finally, an adaptive gradient normalization algorithm is applied to balance the training of multiple loss terms by dynamically tuning the gradient magnitudes. Due to the cooperation of the multi-loss function and the adaptive gradient normalization algorithm, MLDRL effectively restrains the potential interference and achieves effective information fusion. The proposed method is evaluated on multi-center datasets, and the experimental results show that our method not only outperforms several state-of-art methods in pCR prediction, but also achieves better performance in the prognostic analysis of multi-center unlabeled datasets.
Sujet(s)
Tumeurs de l'oesophage , Traitement néoadjuvant , Algorithmes , Tumeurs de l'oesophage/imagerie diagnostique , Tumeurs de l'oesophage/anatomopathologie , Tumeurs de l'oesophage/thérapie , Humains , Traitement néoadjuvant/méthodes , Pronostic , TomodensitométrieRÉSUMÉ
OBJECTIVES: We aimed to develop deep learning models using longitudinal chest X-rays (CXRs) and clinical data to predict in-hospital mortality of COVID-19 patients in the intensive care unit (ICU). METHODS: Six hundred fifty-four patients (212 deceased, 442 alive, 5645 total CXRs) were identified across two institutions. Imaging and clinical data from one institution were used to train five longitudinal transformer-based networks applying five-fold cross-validation. The models were tested on data from the other institution, and pairwise comparisons were used to determine the best-performing models. RESULTS: A higher proportion of deceased patients had elevated white blood cell count, decreased absolute lymphocyte count, elevated creatine concentration, and incidence of cardiovascular and chronic kidney disease. A model based on pre-ICU CXRs achieved an AUC of 0.632 and an accuracy of 0.593, and a model based on ICU CXRs achieved an AUC of 0.697 and an accuracy of 0.657. A model based on all longitudinal CXRs (both pre-ICU and ICU) achieved an AUC of 0.702 and an accuracy of 0.694. A model based on clinical data alone achieved an AUC of 0.653 and an accuracy of 0.657. The addition of longitudinal imaging to clinical data in a combined model significantly improved performance, reaching an AUC of 0.727 (p = 0.039) and an accuracy of 0.732. CONCLUSIONS: The addition of longitudinal CXRs to clinical data significantly improves mortality prediction with deep learning for COVID-19 patients in the ICU. KEY POINTS: ⢠Deep learning was used to predict mortality in COVID-19 ICU patients. ⢠Serial radiographs and clinical data were used. ⢠The models could inform clinical decision-making and resource allocation.
Sujet(s)
COVID-19 , Apprentissage profond , Humains , Unités de soins intensifs , Radiographie , Rayons XRÉSUMÉ
Effective fusion of multimodal magnetic resonance imaging (MRI) is of great significance to boost the accuracy of glioma grading thanks to the complementary information provided by different imaging modalities. However, how to extract the common and distinctive information from MRI to achieve complementarity is still an open problem in information fusion research. In this study, we propose a deep neural network model termed as multimodal disentangled variational autoencoder (MMD-VAE) for glioma grading based on radiomics features extracted from preoperative multimodal MRI images. Specifically, the radiomics features are quantized and extracted from the region of interest for each modality. Then, the latent representations of variational autoencoder for these features are disentangled into common and distinctive representations to obtain the shared and complementary data among modalities. Afterwards, cross-modality reconstruction loss and common-distinctive loss are designed to ensure the effectiveness of the disentangled representations. Finally, the disentangled common and distinctive representations are fused to predict the glioma grades, and SHapley Additive exPlanations (SHAP) is adopted to quantitatively interpret and analyze the contribution of the important features to grading. Experimental results on two benchmark datasets demonstrate that the proposed MMD-VAE model achieves encouraging predictive performance (AUC:0.9939) on a public dataset, and good generalization performance (AUC:0.9611) on a cross-institutional private dataset. These quantitative results and interpretations may help radiologists understand gliomas better and make better treatment decisions for improving clinical outcomes.
Sujet(s)
Gliome , Gliome/imagerie diagnostique , Gliome/anatomopathologie , Humains , Imagerie par résonance magnétique/méthodes , Grading des tumeurs ,RÉSUMÉ
Accurate and rapid diagnosis of coronavirus disease 2019 (COVID-19) from chest CT scans is of great importance and urgency during the worldwide outbreak. However, radiologists have to distinguish COVID-19 pneumonia from other pneumonia in a large number of CT scans, which is tedious and inefficient. Thus, it is urgently and clinically needed to develop an efficient and accurate diagnostic tool to help radiologists to fulfill the difficult task. In this study, we proposed a deep supervised autoencoder (DSAE) framework to automatically identify COVID-19 using multi-view features extracted from CT images. To fully explore features characterizing CT images from different frequency domains, DSAE was proposed to learn the latent representation by multi-task learning. The proposal was designed to both encode valuable information from different frequency features and construct a compact class structure for separability. To achieve this, we designed a multi-task loss function, which consists of a supervised loss and a reconstruction loss. Our proposed method was evaluated on a newly collected dataset of 787 subjects including COVID-19 pneumonia patients, other pneumonia patients, and normal subjects without abnormal CT findings. Extensive experimental results demonstrated that our proposed method achieved encouraging diagnostic performance and may have potential clinical application for the diagnosis of COVID-19.
Sujet(s)
COVID-19 , Apprentissage profond , Pneumopathie infectieuse , COVID-19/imagerie diagnostique , Dépistage de la COVID-19 , Humains , SARS-CoV-2 , TomodensitométrieRÉSUMÉ
The accurate prediction of glioma grade before surgery is essential for treatment planning and prognosis. Since the gold standard (i.e., biopsy)for grading gliomas is both highly invasive and expensive, and there is a need for a noninvasive and accurate method. In this study, we proposed a novel radiomics-based pipeline by incorporating the intratumoral and peritumoral features extracted from preoperative mpMRI scans to accurately and noninvasively predict glioma grade. To address the unclear peritumoral boundary, we designed an algorithm to capture the peritumoral region with a specified radius. The mpMRI scans of 285 patients derived from a multi-institutional study were adopted. A total of 2153 radiomic features were calculated separately from intratumoral volumes (ITVs)and peritumoral volumes (PTVs)on mpMRI scans, and then refined using LASSO and mRMR feature ranking methods. The top-ranking radiomic features were entered into the classifiers to build radiomic signatures for predicting glioma grade. The prediction performance was evaluated with five-fold cross-validation on a patient-level split. The radiomic signatures utilizing the features of ITV and PTV both show a high accuracy in predicting glioma grade, with AUCs reaching 0.968. By incorporating the features of ITV and PTV, the AUC of IPTV radiomic signature can be increased to 0.975, which outperforms the state-of-the-art methods. Additionally, our proposed method was further demonstrated to have strong generalization performance in an external validation dataset with 65 patients. The source code of our implementation is made publicly available at https://github.com/chengjianhong/glioma_grading.git.
Sujet(s)
Gliome , Imagerie par résonance magnétique multiparamétrique , Algorithmes , Gliome/imagerie diagnostique , Humains , Imagerie par résonance magnétique/méthodes , Études rétrospectivesRÉSUMÉ
Chestnut rose (Rosa roxburghii Tratt) is a rare fruit crop of promising economical importance in fruit and ornamental exploitation in China. Isolation of high quality RNA from chestnut rose is difficult due to its high levels of polyphenols, polysaccharides and other compounds, but a modified CTAB extraction procedure without phenol gave satisfactory results. High concentrations of PVP (2%, w/v), CTAB (2%, w/v) and beta-mercaptoethanol (4%, v/v) were used in the extraction buffer to improve RNA quality. The average yield was about 200 microg RNA g(-1) fresh leaves. The isolated RNA was of sufficient quality for construction of suppression subtraction hybridization (SSH) library, which allowed the isolation of several pathogen-induced defense genes.