Automatic assessment of DWI-ASPECTS for acute ischemic stroke based on deep learning.

BACKGROUND: Alberta Stroke Program Early Computed Tomography Score (ASPECTS) is a standardized semi-quantitative method for early ischemic changes in acute ischemic stroke. PURPOSE: However, ASPECTS is still affected by expert experience and inconsistent results between readers in clinical. This study aims to propose an automatic ASPECTS scoring model based on diffusion-weighted imaging (DWI) mode to help clinicians make accurate treatment plans. METHODS: Eighty-two patients with stroke were included in the study. First, we designed a new deep learning network for segmenting ASPECTS scoring brain regions. The network is improved based on U-net, which integrates multiple modules. Second, we proposed using hybrid classifiers to classify brain regions. For brain regions with larger areas, we used brain grayscale comparison algorithm to train machine learning classifiers, while using hybrid feature training for brain regions with smaller areas. RESULTS: The average DICE coefficient of the segmented hindbrain area can reach 0.864. With the proposed hybrid classifier, our method performs significantly on both region-level ASPECTS and dichotomous ASPECTS. The sensitivity and accuracy on the test set are 95.51% and 93.43%, respectively. For dichotomous ASPECTS, the intraclass correlation coefficient (ICC) between our automated ASPECTS score and the expert reading was 0.87. CONCLUSIONS: This study proposed an automated model for ASPECTS scoring of patients with acute ischemic stroke based on DWI images. Experimental results show that the method of segmentation first and then classification is feasible. Our method has the potential to assist physicians in the Alberta Stroke Program with early CT scoring and clinical stroke diagnosis.

Feature Fusion for Multi-Coil Compressed MR Image Reconstruction.

Magnetic resonance imaging (MRI) occupies a pivotal position within contemporary diagnostic imaging modalities, offering non-invasive and radiation-free scanning. Despite its significance, MRI's principal limitation is the protracted data acquisition time, which hampers broader practical application. Promising deep learning (DL) methods for undersampled magnetic resonance (MR) image reconstruction outperform the traditional approaches in terms of speed and image quality. However, the intricate inter-coil correlations have been insufficiently addressed, leading to an underexploitation of the rich information inherent in multi-coil acquisitions. In this article, we proposed a method called "Multi-coil Feature Fusion Variation Network" (MFFVN), which introduces an encoder to extract the feature from multi-coil MR image directly and explicitly, followed by a feature fusion operation. Coil reshaping enables the 2D network to achieve satisfactory reconstruction results, while avoiding the introduction of a significant number of parameters and preserving inter-coil information. Compared with VN, MFFVN yields an improvement in the average PSNR and SSIM of the test set, registering enhancements of 0.2622 dB and 0.0021 dB respectively. This uplift can be attributed to the integration of feature extraction and fusion stages into the network's architecture, thereby effectively leveraging and combining the multi-coil information for enhanced image reconstruction quality. The proposed method outperforms the state-of-the-art methods on fastMRI dataset of multi-coil brains under a fourfold acceleration factor without incurring substantial computation overhead.

Identifying Leukoaraiosis with Mild Cognitive Impairment by Fusing Multiple MRI Morphological Metrics and Ensemble Machine Learning.

Leukoaraiosis (LA) is strongly associated with impaired cognition and increased dementia risk. Determining effective and robust methods of identifying LA patients with mild cognitive impairment (LA-MCI) is important for clinical intervention and disease monitoring. In this study, an ensemble learning method that combines multiple magnetic resonance imaging (MRI) morphological features is proposed to distinguish LA-MCI patients from LA patients lacking cognitive impairment (LA-nCI). Multiple comprehensive morphological measures (including gray matter volume (GMV), cortical thickness (CT), surface area (SA), cortical volume (CV), sulcus depth (SD), fractal dimension (FD), and gyrification index (GI)) are extracted from MRI to enrich model training on disease characterization information. Then, based on the general extreme gradient boosting (XGBoost) classifier, we leverage a weighted soft-voting ensemble framework to ensemble a data-level resampling method (Fusion + XGBoost) and an algorithm-level focal loss (FL)-improved XGBoost model (FL-XGBoost) to overcome class-imbalance learning problems and provide superior classification performance and stability. The baseline XGBoost model trained on an original imbalanced dataset had a balanced accuracy (Bacc) of 78.20%. The separate Fusion + XGBoost and FL-XGBoost models achieved Bacc scores of 80.53 and 81.25%, respectively, which are clear improvements (i.e., 2.33% and 3.05%, respectively). The fused model distinguishes LA-MCI from LA-nCI with an overall accuracy of 84.82%. Sensitivity and specificity were also well improved (85.50 and 84.14%, respectively). This improved model has the potential to facilitate the clinical diagnosis of LA-MCI.

A deep learning and radiomics based Alberta stroke program early CT score method on CTA to evaluate acute ischemic stroke.

BACKGROUND: Alberta stroke program early CT score (ASPECTS) is a semi-quantitative evaluation method used to evaluate early ischemic changes in patients with acute ischemic stroke, which can guide physicians in treatment decisions and prognostic judgments. OBJECTIVE: We propose a method combining deep learning and radiomics to alleviate the problem of large inter-observer variance in ASPECTS faced by physicians and assist them to improve the accuracy and comprehensiveness of the ASPECTS. METHODS: Our study used a brain region segmentation method based on an improved encoding-decoding network. Through the deep convolutional neural network, 10 regions defined for ASPECTS will be obtained. Then, we used Pyradiomics to extract features associated with cerebral infarction and select those significantly associated with stroke to train machine learning classifiers to determine the presence of cerebral infarction in each scored brain region. RESULTS: The experimental results show that the Dice coefficient for brain region segmentation reaches 0.79. Three radioactive features are selected to identify cerebral infarction in brain regions, and the 5-fold cross-validation experiment proves that these 3 features are reliable. The classifier trained based on 3 features reaches prediction performance of AUC = 0.95. Moreover, the intraclass correlation coefficient of ASPECTS between those obtained by the automated ASPECTS method and physicians is 0.86 (95% confidence interval, 0.56-0.96). CONCLUSIONS: This study demonstrates advantages of using a deep learning network to replace the traditional template registration for brain region segmentation, which can determine the shape and location of each brain region more precisely. In addition, a new brain region classifier based on radiomics features has potential to assist physicians in clinical stroke detection and improve the consistency of ASPECTS.

Segmentation of lung nodules based on a refined segmentation network.

BACKGROUND: Accurate segmentation of lung nodules is of great significance for early screening and diagnosis of lung cancer. PURPOSE: However, the heterogeneity of lung nodules and the similarities between them and other lung tissues make it difficult to accurately segment these nodules. As regards the use of deep learning to segment lung nodules, convolutional neural networks would gradually lead to errors accumulating at the network layer due to the presence of multiple upsampling and downsampling layers, resulting in poor segmentation results. METHODS: In this study, we developed a refined segmentation network (RS-Net) for lung nodule segmentation to solve this problem. Accordingly, the proposed RS-Net was first used to locate the core region of the lung nodules and to gradually refine the segmentation results of the core region. In addition, to solve the problem of misdetection of small-sized nodules owing to the imbalance of positive and negative samples, we devised an average dice-loss function computed on nodule level. By calculating the loss of each nodule sample to measure the overall loss, the network can address the misdetection problem of lung nodules with smaller diameters more efficiently. RESULTS: Our method was evaluated based on 1055 lung nodules from Lung Image Database Consortium data and a set of 120 lung nodules collected from Shanghai Chest Hospital for additional validation. The segmentation dice coefficients of RS-Net on these two datasets were 85.90% and 81.13%, respectively. The analysis of the segmentation effect of different properties and sizes of nodules indicates that RS-Net yields a stable segmentation effect. CONCLUSIONS: The results show that the segmentation strategy based on gradual refinement can considerably improve the segmentation of lung nodules.

Molecular-subtype guided automatic invasive breast cancer grading using dynamic contrast-enhanced MRI.

BACKGROUND AND OBJECTIVES: Histological grade and molecular subtype have presented valuable references in assigning personalized or precision medicine as the significant prognostic indicators representing biological behaviors of invasive breast cancer (IBC). To evaluate a two-stage deep learning framework for IBC grading that incorporates with molecular-subtype (MS) information using DCE-MRI. METHODS: In Stage I, an innovative neural network called IOS2-DA is developed, which includes a dense atrous-spatial pyramid pooling block with a pooling layer (DA) and inception-octconved blocks with double kernel squeeze-and-excitations (IOS2). This method focuses on the imaging manifestation of IBC grades and performs preliminary prediction using a novel class F1-score loss function. In Stage II, a MS attention branch is introduced to fine-tune the integrated deep vectors from IOS2-DA via Kullback-Leibler divergence. The MS-guided information is weighted with preliminary results to obtain classification values, which are analyzed by ensemble learning for tumor grade prediction on three MRI post-contrast series. Objective assessment is quantitatively evaluated by receiver operating characteristic curve analysis. DeLong test is applied to measure statistical significance (P < 0.05). RESULTS: The molecular-subtype guided IOS2-DA performs significantly better than the single IOS2-DA in terms of accuracy (0.927), precision (0.942), AUC (0.927, 95% CI: [0.908, 0.946]), and F1-score (0.930). The gradient-weighted class activation maps show that the feature representations extracted from IOS2-DA are consistent with tumor areas. CONCLUSIONS: IOS2-DA elucidates its potential in non-invasive tumor grade prediction. With respect to the correlation between MS and histological grade, it exhibits remarkable clinical prospects in the application of relevant clinical biomarkers to enhance the diagnostic effectiveness of IBC grading. Therefore, DCE-MRI tends to be a feasible imaging modality for the thorough preoperative assessment of breast biological behavior and carcinoma prognosis.

Joint two-stage convolutional neural networks for intracranial aneurysms detection on 3D TOF-MRA.

Objective. This study aims to develop a three-dimensional convolutional neural network utilizing computer-aided diagnostic technology to facilitate the detection of intracranial aneurysms and automatically assess their location and extent, thereby enhancing the efficiency of radiologists, and streamlining clinical workflows.Approach. A retrospective study was conducted, proposing a joint segmentation and classification network (JSCD-Net) that employs 3D time-of-flight magnetic resonance angiography images for preliminary detection of aneurysms and the minimization of false positives. Specifically, the U-Net++ network was utilized for pre-detection of aneurysms. This was followed by the creation of a multi-path network, co-trained with U-Net++ to correct the results of the first stage to further reduce the rate of false positives. Model effectiveness and robustness were evaluated using sensitivity and false positive analyses on internal and external datasets. A cross-validated free-response receiver operating characteristic curve was also plotted.Main results. JSCD-Net demonstrated a sensitivity of 91.2% (31 of 34; 95% CI: 77.0, 97.0) with an average of 3.55 false positives per scan on the internal test set. For the external test set, it identified 97.2% (70 of 72; 95% CI: 90.4, 99.2) of aneurysms with an average of 2.7 false positives per scan.Significance. When compared with the existing studies, the proposed model shows high sensitivity in detecting intracranial aneurysms with a reasonable number of false positives per case. This result emphasizes the model's potential as a valuable tool in aiding clinical diagnoses.

[Application of generative adversarial network in magnetic resonance image reconstruction].

Magnetic resonance imaging (MRI) is an important medical imaging method, whose major limitation is its long scan time due to the imaging mechanism, increasing patients' cost and waiting time for the examination. Currently, parallel imaging (PI) and compress sensing (CS) together with other reconstruction technologies have been proposed to accelerate image acquisition. However, the image quality of PI and CS depends on the image reconstruction algorithms, which is far from satisfying in respect to both the image quality and the reconstruction speed. In recent years, image reconstruction based on generative adversarial network (GAN) has become a research hotspot in the field of magnetic resonance imaging because of its excellent performance. In this review, we summarized the recent development of application of GAN in MRI reconstruction in both single- and multi-modality acceleration, hoping to provide a useful reference for interested researchers. In addition, we analyzed the characteristics and limitations of existing technologies and forecasted some development trends in this field.

Automatic Alberta Stroke Program Early Computed Tomographic Scoring in patients with acute ischemic stroke using diffusion-weighted imaging.

Alberta Stroke Program Early Computed Tomographic Scoring (ASPECTS) is a reliable method for assessing early ischemic changes in the blood supply area of the middle cerebral artery in patients with acute ischemic stroke. This study aims to propose a deep learning based automatic evaluation strategy for DWI-ASPECTS to serve as a reference for clinicians in urgent decision making for endovascular thrombectomy. Ten ASPECTS regions are extracted from the DWI series to train the independent classification network for each region, the accurate training labels of which are confirmed by neuroradiologists. Two classical convolutional neural networks (VGG-16 and ResNet-50) are validated. Subsequently, the innovative CBAM-VGG is designed to improve the accurate scoring of four small-volume DWI-ASPECTS regions, including caudate nucleus, lenticular nucleus, internal capsule, and insular lobe. Average F1-score of 0.929 and 0.840 and the average accuracy of 94.75% and 84.99% are obtained when scoring on six cortical regions M1-M6 and four small ASPECTS regions, respectively. In addition, the modified algorithm CBAM-VGG shows a significant improvement in the accuracy of estimating the four ASPECTS regions with smaller volumes. The experimental results demonstrate that the deep learning methods facilitate the efficiency and robustness of automatic DWI-ASPECTS scoring, which can provide a reference for clinical decision-making.

Weakly Supervised Breast Lesion Detection in Dynamic Contrast-Enhanced MRI.

Currently, obtaining accurate medical annotations requires high labor and time effort, which largely limits the development of supervised learning-based tumor detection tasks. In this work, we investigated a weakly supervised learning model for detecting breast lesions in dynamic contrast-enhanced MRI (DCE-MRI) with only image-level labels. Two hundred fifty-four normal and 398 abnormal cases with pathologically confirmed lesions were retrospectively enrolled into the breast dataset, which was divided into the training set (80%), validation set (10%), and testing set (10%) at the patient level. First, the second image series S2 after the injection of a contrast agent was acquired from the 3.0-T, T1-weighted dynamic enhanced MR imaging sequences. Second, a feature pyramid network (FPN) with convolutional block attention module (CBAM) was proposed to extract multi-scale feature maps of the modified classification network VGG16. Then, initial location information was obtained from the heatmaps generated using the layer class activation mapping algorithm (Layer-CAM). Finally, the detection results of breast lesion were refined by the conditional random field (CRF). Accuracy, sensitivity, specificity, and area under the receiver operating characteristic (ROC) curve (AUC) were utilized for evaluation of image-level classification. Average precision (AP) was estimated for breast lesion localization. Delong's test was used to compare the AUCs of different models for significance. The proposed model was effective with accuracy of 95.2%, sensitivity of 91.6%, specificity of 99.2%, and AUC of 0.986. The AP for breast lesion detection was 84.1% using weakly supervised learning. Weakly supervised learning based on FPN combined with Layer-CAM facilitated automatic detection of breast lesion.

Accelerating image reconstruction for multi-contrast MRI based on Y-Net3.

BACKGROUND: As one of the significant preoperative imaging modalities in medical diagnosis, Magnetic resonance imaging (MRI) takes a long scanning time due to its special imaging principle. OBJECTIVE: We propose an innovative MRI reconstruction strategy and data consistency method based on deep learning to reconstruct high-quality brain MRIs from down-sampled data and accelerate the MR imaging process. METHODS: Sixteen healthy subjects undergoing T1-weighted spin-echo (SE) and T2-weighted fast spin-echo (FSE) sequences by a 1.5T MRI scanner were recruited. A Y-Net3+ network was used to facilitate the high-quality MRI reconstruction through context information. In addition, the existing data consistency fidelity method was improved. The difference between the reconstructed K-space and the original K-space was shorten by the linear regression algorithm. Therefore, the redundant artifacts derived from under-sampling were avoided. The Structural Similarity (SSIM) and Peak Signal to Noise Ratio (PSNR) were applied to quantitatively evaluate image reconstruction performance of different down-sampling patterns. RESULTS: Compared with the classical Y-Net, Y-Net3+ network improved SSIM and PSNR of MRI images from 0.9164±0.0178 and 33.2216±3.2919 to 0.9387±0.0363 and 35.1785±3.3105, respectively, under compressed sensing reconstruction with acceleration factor of 4. The improved network increases signal-to-noise ratio and adds more image texture information in the reconstructed images. Furthermore, in the process of data consistency, linear regression analysis was used to reduce the difference between the reconstructed K-space and the original K-space, so that the SSIM and PSNR were increased to 0.9808±0.0081 and 40.9254±1.1911, respectively. CONCLUSIONS: The improved Y-Net combined with data consistency fidelity method elucidates its potential in reconstructing high-quality T2-weighted images from the down-sampled data by fully exploring the T1-weighted information. With the advantage of avoiding down-sampled artifacts, the improved network exhibits remarkable clinical promise for fast MRI applications.

Significance of cuproptosis- related genes in the diagnosis and classification of psoriasis.

Cuproptosis is a novel form of cell death linked to mitochondrial metabolism and is mediated by protein lipoylation. The mechanism of cuproptosis in many diseases, such as psoriasis, remains unclear. In this study, signature diagnostic markers of cuproptosis were screened by differential analysis between psoriatic and non-psoriatic patients. The differentially expressed cuproptosis-related genes (CRGs) for patients with psoriasis were screened using the GSE178197 dataset from the gene expression omnibus database. The biological roles of CRGs were identified by GO and KEGG enrichment analyses, and the candidates of cuproptosis-related regulators were selected from a nomogram model. The consensus clustering approach was used to classify psoriasis into clusters and the principal component analysis algorithms were constructed to calculate the cuproptosis score. Finally, latent diagnostic markers and drug sensitivity were analyzed using the pRRophetic R package. The differential analysis revealed that CRGs (MTF1, ATP7B, and SLC31A1) are significantly expressed in psoriatic patients. GO and KEGG enrichment analyses showed that the biological functions of CRGs were mainly related to acetyl-CoA metabolic processes, the mitochondrial matrix, and acyltransferase activity. Compared to the machine learning method used, the random forest model has higher accuracy in the occurrence of cuproptosis. However, the decision curve of the candidate cuproptosis regulators analysis showed that patients can benefit from the nomogram model. The consensus clustering analysis showed that psoriasis can be grouped into three patterns of cuproptosis (clusterA, clusterB, and clusterC) based on selected important regulators of cuproptosis. In advance, we analyzed the immune characteristics of patients and found that clusterA was associated with T cells, clusterB with neutrophil cells, and clusterC predominantly with B cells. Drug sensitivity analysis showed that three cuproptosis regulators (ATP7B, SLC31A1, and MTF1) were associated with the drug sensitivity. This study provides insight into the specific biological functions and related mechanisms of CRGs in the development of psoriasis and indicates that cuproptosis plays a non-negligible role. These results may help guide future treatment strategies for psoriasis.

Weakly supervised breast lesion detection in DCE-MRI using self-transfer learning.

BACKGROUND: Breast cancer is a typically diagnosed and life-threatening cancer in women. Thus, dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) is increasingly used for breast lesion detection and diagnosis because of the high resolution of soft tissues. Moreover, supervised detection methods have been implemented for breast lesion detection. However, these methods require substantial time and specialized staff to develop the labeled training samples. PURPOSE: To investigate the potential of weakly supervised deep learning models for breast lesion detection. METHODS: A total of 1003 breast DCE-MRI studies were collected, including 603 abnormal cases with 770 breast lesions and 400 normal subjects. The proposed model was trained using breast DCE-MRI considering only the image-level labels (normal and abnormal) and optimized for classification and detection sub-tasks simultaneously. Ablation experiments were performed to evaluate different convolutional neural network (CNN) backbones (VGG19 and ResNet50) as shared convolutional layers, as well as to evaluate the effect of the preprocessing methods. RESULTS: Our weakly supervised model performed better with VGG19 than with ResNet50 (p < 0.05). The average precision (AP) of the classification sub-task was 91.7% for abnormal cases and 88.0% for normal samples. The area under the receiver operating characteristic (ROC) curve (AUC) was 0.939 (95% confidence interval [CI]: 0.920-0.941). The weakly supervised detection task AP was 85.7%, and the correct location (CorLoc) was 90.2%. A sensitivity of 84.0% at two-false positives per image was assessed based on free-response ROC (FROC) curve. CONCLUSIONS: The results confirm that a weakly supervised CNN based on self-transfer learning is an effective and promising auxiliary tool for detecting breast lesions.

Ischemic stroke subtyping method combining convolutional neural network and radiomics.

BACKGROUND: Cardiogenic embolism (CE) and large-artery atherosclerosis embolism (LAA) are the two most common ischemic stroke (IS) subtypes. OBJECTIVE: In order to assist doctors in the precise diagnosis and treatment of patients, this study proposed an IS subtyping method combining convolutional neural networks (CNN) and radiomics. METHODS: Firstly, brain embolism regions were segmented from the computed tomography angiography (CTA) images, and radiomics features were extracted; Secondly, the extracted radiomics features were optimized with the L2 norm, and the feature selection was performed by combining random forest; then, the CNN Cap-UNet was built to extract the deep learning features of the last layer of the network; Finally, combining the selected radiomics features and deep learning features, 9 small-sample classifiers were trained respectively to build and select the optimal IS subtyping classification model. RESULTS: The experimental data include CTA images of 82 IS patients diagnosed and treated in Shanghai Sixth People's Hospital. The AUC value and accuracy of the optimal subtyping model based on the Adaboost classifier are 0.9018 and 0.8929, respectively. CONCLUSION: The experimental results show that the proposed method can effectively predict the subtype of IS and has potential to assist doctors in making timely and accurate diagnoses of IS patients.

A Novel Deep Learning Model Based on Multi-Scale and Multi-View for Detection of Pulmonary Nodules.

Lung cancer manifests as pulmonary nodules in the early stage. Thus, the early and accurate detection of these nodules is crucial for improving the survival rate of patients. We propose a novel two-stage model for lung nodule detection. In the candidate nodule detection stage, a deep learning model based on 3D context information roughly segments the nodules detects the preprocessed image and obtain candidate nodules. In this model, 3D image blocks are input into the constructed model, and it learns the contextual information between the various slices in the 3D image block. The parameters of our model are equivalent to those of a 2D convolutional neural network (CNN), but the model could effectively learn the 3D context information of the nodules. In the false-positive reduction stage, we propose a multi-scale shared convolutional structure model. Our lung detection model has no significant increase in parameters and computation in both stages of multi-scale and multi-view detection. The proposed model was evaluated by using 888 computed tomography (CT) scans from the LIDC-IDRI dataset and achieved a competition performance metric (CPM) score of 0.957. The average detection sensitivity per scan was 0.971/1.0 FP. Furthermore, an average detection sensitivity of 0.933/1.0 FP per scan was achieved based on data from Shanghai Pulmonary Hospital. Our model exhibited a higher detection sensitivity, a lower false-positive rate, and better generalization than current lung nodule detection methods. The method has fewer parameters and less computational complexity, which provides more possibilities for the clinical application of this method.

A method for distinguishing benign and malignant pulmonary nodules based on 3D dual path network aided by K-means clustering analysis.

In the USA, there were about 1 |806 |590 new cancer cases in 2020, and 606 520 cancer deaths are expected to have occurred in 2021. Lung cancer has become the leading cause of death from cancer in both men and women (Siegel et al., 2020). Clinical studies show that the five-year survival rate of lung cancer patients after early diagnosis and treatment intervention can reach 80%, compared with that of patients having advanced lung cancer. Thus, the early diagnosis of lung cancer is a key factor to reduce mortality.

The influence of white matter hyperintensities severity on functional brain activity in cerebral small vessel disease: An rs-fMRI study.

OBJECTIVE: To investigate relationships between the severity of white matter hyperintensities (WMH), functional brain activity, and cognition in cerebral small vessel disease (CSVD) based on resting-state functional magnetic resonance imaging (rs-fMRI) data. METHODS: A total of 103 subjects with CSVD were included. The amplitude of low frequency fluctuations (ALFF), regional homogeneity (ReHo), functional connectivity (FC) and their graph properties were applied to explore the influence of WMH burden on functional brain activity. We also investigated whether there are correlations between different functional brain characteristics and cognitive assessments. Finally, we selected disease-related rs-fMRI features in combination with ensemble learning to classify CSVD patients with low WMH load and with high WMH load. RESULTS: The high WMH load group demonstrated significantly abnormal functional brain activity based on rs-MRI data, relative to the low WMH load group. ALFF and graph properties in specific brain regions were significantly correlated with patients' cognitive assessments in CSVD. Moreover, altered rs-fMRI signal can help predict the severity of WMH in CSVD patients with an overall accuracy of 92.23%. CONCLUSIONS: This study provided a comprehensive analysis and evidence for a pattern of altered functional brain activity under different WMH load in CSVD based on rs-fMRI data, enabling accurately individual prediction of status of WMH.

[Segmentation of ground glass pulmonary nodules using full convolution residual network based on atrous spatial pyramid pooling structure and attention mechanism].

Accurate segmentation of ground glass nodule (GGN) is important in clinical. But it is a tough work to segment the GGN, as the GGN in the computed tomography images show blur boundary, irregular shape, and uneven intensity. This paper aims to segment GGN by proposing a fully convolutional residual network, i.e., residual network based on atrous spatial pyramid pooling structure and attention mechanism (ResAANet). The network uses atrous spatial pyramid pooling (ASPP) structure to expand the feature map receptive field and extract more sufficient features, and utilizes attention mechanism, residual connection, long skip connection to fully retain sensitive features, which is extracted by the convolutional layer. First, we employ 565 GGN provided by Shanghai Chest Hospital to train and validate ResAANet, so as to obtain a stable model. Then, two groups of data selected from clinical examinations (84 GGN) and lung image database consortium (LIDC) dataset (145 GGN) were employed to validate and evaluate the performance of the proposed method. Finally, we apply the best threshold method to remove false positive regions and obtain optimized results. The average dice similarity coefficient (DSC) of the proposed algorithm on the clinical dataset and LIDC dataset reached 83.46%, 83.26% respectively, the average Jaccard index (IoU) reached 72.39%, 71.56% respectively, and the speed of segmentation reached 0.1 seconds per image. Comparing with other reported methods, our new method could segment GGN accurately, quickly and robustly. It could provide doctors with important information such as nodule size or density, which assist doctors in subsequent diagnosis and treatment.

Self-supervised learning for multi-center magnetic resonance imaging harmonization without traveling phantoms.

Objective.With the progress of artificial intelligence (AI) in magnetic resonance imaging (MRI), large-scale multi-center MRI datasets have a great influence on diagnosis accuracy and model performance. However, multi-center images are highly variable due to the variety of scanners or scanning parameters in use, which has a negative effect on the generality of AI-based diagnosis models. To address this problem, we propose a self-supervised harmonization (SSH) method.Approach.Mapping the style of images between centers allows harmonization without traveling phantoms to be formalized as an unpaired image-to-image translation problem between two domains. The mapping is a two-stage transform, consisting of a modified cycle generative adversarial network (cycleGAN) for style transfer and a histogram matching module for structure fidelity. The proposed algorithm is demonstrated using female pelvic MRI images from two 3 T systems and compared with three state-of-the-art methods and one conventional method. In the absence of traveling phantoms, we evaluate harmonization from three perspectives: image fidelity, ability to remove inter-center differences, and influence on the downstream model.Main results.The improved image sharpness and structure fidelity are observed using the proposed harmonization pipeline. It largely decreases the number of features with a significant difference between two systems (from 64 to 45, lower than dualGAN: 57, cycleGAN: 59, ComBat: 64, and CLAHE: 54). In the downstream cervical cancer classification, it yields an area under the receiver operating characteristic curve of 0.894 (higher than dualGAN: 0.828, cycleGAN: 0.812, ComBat: 0.685, and CLAHE: 0.770).Significance.Our SSH method yields superior generality of downstream cervical cancer classification models by significantly decreasing the difference in radiomics features, and it achieves greater image fidelity.

Computer-aided detection of pulmonary nodules based on convolutional neural networks: a review.

Computer-aided detection (CADe) technology has been proven to increase the detection rate of pulmonary nodules that has important clinical significance for the early diagnosis of lung cancer. In this study, we systematically review the latest techniques in pulmonary nodule CADe based on deep learning models with convolutional neural networks in computed tomography images. First, the brief descriptions and popular architecture of convolutional neural networks are introduced. Second, several common public databases and evaluation metrics are briefly described. Third, state-of-the-art approaches with excellent performances are selected. Subsequently, we combine the clinical diagnostic process and the traditional four steps of pulmonary nodule CADe into two stages, namely, data preprocessing and image analysis. Further, the major optimizations of deep learning models and algorithms are highlighted according to the progressive evaluation effect of each method, and some clinical evidence is added. Finally, various methods are summarized and compared. The innovative or valuable contributions of each method are expected to guide future research directions. The analyzed results show that deep learning-based methods significantly transformed the detection of pulmonary nodules, and the design of these methods can be inspired by clinical imaging diagnostic procedures. Moreover, focusing on the image analysis stage will result in improved returns. In particular, optimal results can be achieved by optimizing the steps of candidate nodule generation and false positive reduction. End-to-end methods, with greater operating speeds and lower computational consumptions, are superior to other methods in CADe of pulmonary nodules.