Deep learning models for ischemic stroke lesion segmentation in medical images: A survey.

This paper provides a comprehensive review of deep learning models for ischemic stroke lesion segmentation in medical images. Ischemic stroke is a severe neurological disease and a leading cause of death and disability worldwide. Accurate segmentation of stroke lesions in medical images such as MRI and CT scans is crucial for diagnosis, treatment planning and prognosis. This paper first introduces common imaging modalities used for stroke diagnosis, discussing their capabilities in imaging lesions at different disease stages from the acute to chronic stage. It then reviews three major public benchmark datasets for evaluating stroke segmentation algorithms: ATLAS, ISLES and AISD, highlighting their key characteristics. The paper proceeds to provide an overview of foundational deep learning architectures for medical image segmentation, including CNN-based and transformer-based models. It summarizes recent innovations in adapting these architectures to the task of stroke lesion segmentation across the three datasets, analyzing their motivations, modifications and results. A survey of loss functions and data augmentations employed for this task is also included. The paper discusses various aspects related to stroke segmentation tasks, including prior knowledge, small lesions, and multimodal fusion, and then concludes by outlining promising future research directions. Overall, this comprehensive review covers critical technical developments in the field to support continued progress in automated stroke lesion segmentation.

Classification of recurrent major depressive disorder using a residual denoising autoencoder framework: Insights from large-scale multisite fMRI data.

BACKGROUND AND OBJECTIVE: Recurrent major depressive disorder (rMDD) has a high recurrence rate, and symptoms often worsen with each episode. Classifying rMDD using functional magnetic resonance imaging (fMRI) can enhance understanding of brain activity and aid diagnosis and treatment of this disorder. METHODS: We developed a Residual Denoising Autoencoder (Res-DAE) framework for the classification of rMDD. The functional connectivity (FC) was extracted from fMRI data as features. The framework addresses site heterogeneity by employing the Combat method to harmonize feature distribution differences. A feature selection method based on Fisher scores was used to reduce redundant information in the features. A data augmentation strategy using a Synthetic Minority Over-sampling Technique algorithm based on Extended Frobenius Norm measure was incorporated to increase the sample size. Furthermore, a residual module was integrated into the autoencoder network to preserve important features and improve the classification accuracy. RESULTS: We tested our framework on a large-scale, multisite fMRI dataset, which includes 189 rMDD patients and 427 healthy controls. The Res-DAE achieved an average accuracy of 75.1 % (sensitivity = 69 %, specificity = 77.8 %) in cross-validation, thereby outperforming comparison methods. In a larger dataset that also includes first-episode depression (comprising 832 MDD patients and 779 healthy controls), the accuracy reached 70 %. CONCLUSIONS: We proposed a deep learning framework that can effectively classify rMDD and 33 identify the altered FC associated with rMDD. Our study may reveal changes in brain function 34 associated with rMDD and provide assistance for the diagnosis and treatment of rMDD.

Classification of MDD using a Transformer classifier with large-scale multisite resting-state fMRI data.

Major depressive disorder (MDD) is one of the most common psychiatric disorders worldwide with high recurrence rate. Identifying MDD patients, particularly those with recurrent episodes with resting-state fMRI, may reveal the relationship between MDD and brain function. We proposed a Transformer-Encoder model, which utilized functional connectivity extracted from large-scale multisite rs-fMRI datasets to classify MDD and HC. The model discarded the Transformer's Decoder part, reducing the model's complexity and decreasing the number of parameters to adapt to the limited sample size and it does not require a complex feature selection process and achieves end-to-end classification. Additionally, our model is suitable for classifying data combined from multiple brain atlases and has an optional unsupervised pre-training module to acquire optimal initial parameters and speed up the training process. The model's performance was tested on a large-scale multisite dataset and identified brain regions affected by MDD using the Grad-CAM method. After conducting five-fold cross-validation, our model achieved an average classification accuracy of 68.61% on a dataset consisting of 1611 samples. For the selected recurrent MDD dataset, the model reached an average classification accuracy of 78.11%. Abnormalities were detected in the frontal gyri and cerebral cortex of MDD patients in both datasets. Furthermore, the identified brain regions in the recurrent MDD dataset generally exhibited a higher contribution to the model's performance.

Classification of recurrent major depressive disorder using a new time series feature extraction method through multisite rs-fMRI data.

BACKGROUND: Major depressive disorder (MDD) has a high rate of recurrence. Identifying patients with recurrent MDD is advantageous in adopting prevention strategies to reduce the disabling effects of depression. METHOD: We propose a novel feature extraction method that includes dynamic temporal information, and inputs the extracted features into a graph convolutional network (GCN) to achieve classification of recurrent MDD. We extract the average time series using an atlas from resting-state functional magnetic resonance imaging (fMRI) data. Pearson correlation was calculated between brain region sequences at each time point, representing the functional connectivity at each time point. The connectivity is used as the adjacency matrix and the brain region sequences as node features for a GCN model to classify recurrent MDD. Gradient-weighted Class Activation Mapping (Grad-CAM) was used to analyze the contribution of different brain regions to the model. Brain regions making greater contribution to classification were considered to be the regions with altered brain function in recurrent MDD. RESULT: We achieved a classification accuracy of 75.8 % for recurrent MDD on the multi-site dataset, the Rest-meta-MDD. The brain regions closely related to recurrent MDD have been identified. LIMITATION: The pre-processing stage may affect the final classification performance and harmonizing site differences may improve the classification performance. CONCLUSION: The experimental results demonstrate that the proposed method can effectively classify recurrent MDD and extract dynamic changes of brain activity patterns in recurrent depression.

Semi-supervised OCT lesion segmentation via transformation-consistent with uncertainty and self-deep supervision.

Optical coherence tomography (OCT) is a non-invasive, high-resolution ocular imaging technique with important implications for the diagnosis and management of retinal diseases. Automatic segmentation of lesions in OCT images is critical for assessing disease progression and treatment outcomes. However, existing methods for lesion segmentation require numerous pixel-wise annotations, which are difficult and time-consuming to obtain. To address this challenge, we propose a novel framework for semi-supervised OCT lesion segmentation, termed transformation-consistent with uncertainty and self-deep supervision (TCUS). To address the issue of lesion area blurring in OCT images and unreliable predictions from the teacher network for unlabeled images, an uncertainty-guided transformation-consistent strategy is proposed. Transformation-consistent is used to enhance the unsupervised regularization effect. The student network gradually learns from meaningful and reliable targets by utilizing the uncertainty information from the teacher network, to alleviate the performance degradation caused by potential errors in the teacher network's prediction results. Additionally, self-deep supervision is used to acquire multi-scale information from labeled and unlabeled OCT images, enabling accurate segmentation of lesions of various sizes and shapes. Self-deep supervision significantly improves the accuracy of lesion segmentation in terms of the Dice coefficient. Experimental results on two OCT datasets demonstrate that the proposed TCUS outperforms state-of-the-art semi-supervised segmentation methods.

AC-E Network: Attentive Context-Enhanced Network for Liver Segmentation.

Segmentation of liver from CT scans is essential in computer-aided liver disease diagnosis and treatment. However, the 2DCNN ignores the 3D context, and the 3DCNN suffers from numerous learnable parameters and high computational cost. In order to overcome this limitation, we propose an Attentive Context-Enhanced Network (AC-E Network) consisting of 1) an attentive context encoding module (ACEM) that can be integrated into the 2D backbone to extract 3D context without a sharp increase in the number of learnable parameters; 2) a dual segmentation branch including complemental loss making the network attend to both the liver region and boundary so that getting the segmented liver surface with high accuracy. Extensive experiments on the LiTS and the 3D-IRCADb datasets demonstrate that our method outperforms existing approaches and is competitive to the state-of-the-art 2D-3D hybrid method on the equilibrium of the segmentation precision and the number of model parameters.

Altered Effective Connectivity Among the Cerebellum and Cerebrum in Patients with Major Depressive Disorder Using Multisite Resting-State fMRI.

Major depressive disorder (MDD) is a serious and widespread psychiatric disorder. Previous studies mainly focused on cerebrum functional connectivity, and the sample size was relatively small. However, functional connectivity is undirected. And, there is increasing evidence that the cerebellum is also involved in emotion and cognitive processing and makes outstanding contributions to the symptomology and pathology of depression. Therefore, we used a large sample size of resting-state functional magnetic resonance imaging (rs-fMRI) data to investigate the altered effective connectivity (EC) among the cerebellum and other cerebral cortex in patients with MDD. Here, from the perspective of data-driven analysis, we used two different atlases to divide the whole brain into different regions and analyzed the alterations of EC and EC networks in the MDD group compared with healthy controls group (HCs). The results showed that compared with HCs, there were significantly altered EC in the cerebellum-neocortex and cerebellum-basal ganglia circuits in MDD patients, which implied that the cerebellum may be a potential biomarker of depressive disorders. And, the alterations of EC brain networks in MDD patients may provide new insights into the pathophysiological mechanisms of depression.

The alterations of brain functional connectivity networks in major depressive disorder detected by machine learning through multisite rs-fMRI data.

BACKGROUND: The current diagnosis of major depressive disorder (MDD) is mainly based on the patient's self-report and clinical symptoms. Machine learning methods are used to identify MDD using resting-state functional magnetic resonance imaging (rs-fMRI) data. However, due to large site differences in multisite rs-fMRI data and the difficulty of sample collection, most of the current machine learning studies use small sample sizes of rs-fMRI datasets to detect the alterations of functional connectivity (FC) or network attribute (NA), which may affect the reliability of the experimental results. METHODS: Multisite rs-fMRI data were used to increase the size of the sample, and then we extracted the functional connectivity (FC) and network attribute (NA) features from 1611 rs-fMRI data (832 patients with MDD (MDDs) and 779 healthy controls (HCs)). ComBat algorithm was used to harmonize the data variances caused by the multisite effect, and multivariate linear regression was used to remove age and sex covariates. Two-sample t-test and wrapper-based feature selection methods (support vector machine recursive feature elimination with cross-validation (SVM-RFECV) and LightGBM's "feature_importances_" function) were used to select important features. The Shapley additive explanations (SHAP) method was used to assign the contribution of features to the best classification effect model. RESULTS: The best result was obtained from the LinearSVM model trained with the 136 important features selected by SVMRFE-CV. In the nested five-fold cross-validation (consisting of an outer and an inner loop of five-fold cross-validation) of 1611 data, the model achieved the accuracy, sensitivity, and specificity of 68.90 %, 71.75 %, and 65.84 %, respectively. The 136 important features were tested in a small dataset and obtained excellent classification results after balancing the ratio between patients with depression and HCs. CONCLUSIONS: The combined use of FC and NA features is effective for classifying MDDs and HCs. The important FC and NA features extracted from the large sample dataset have some generalization performance and may be used as a reference for the altered brain functional connectivity networks in MDD.

A strategy of model space search for dynamic causal modeling in task fMRI data exploratory analysis.

Dynamic causal modeling (DCM) is a tool used for effective connectivity (EC) estimation in neuroimage analysis. But it is a model-driven analysis method, and the structure of the EC network needs to be determined in advance based on a large amount of prior knowledge. This characteristic makes it difficult to apply DCM to the exploratory brain network analysis. The exploratory analysis of DCM can be realized from two perspectives: one is to reduce the computational cost of the model; the other is to reduce the model space. From the perspective of model space reduction, a model space exploration strategy is proposed, including two algorithms. One algorithm, named GreedyEC, starts with reducing EC from full model, and the other, named GreedyROI, start with adding EC from one node model. Then the two algorithms were applied to the task state functional magnetic resonance imaging (fMRI) data of visual object recognition and selected the best DCM model from the perspective of model comparison based on Bayesian model compare method. Results show that combining the results of the two algorithms can further improve the effect of DCM exploratory analysis. For convenience in application, the algorithms were encapsulated into MATLAB function based on SPM to help neuroscience researchers to analyze the brain causal information flow network. The strategy provides a model space exploration tool that may obtain the best model from the perspective of model comparison and lower the threshold of DCM analysis.

Altered Effective Connectivity of Children and Young Adults With Unilateral Amblyopia: A Resting-State Functional Magnetic Resonance Imaging Study.

The altered functional connectivity (FC) in amblyopia has been investigated by many studies, but the specific causality of brain connectivity needs to be explored further to understand the brain activity of amblyopia. We investigated whether the effective connectivity (EC) of children and young adults with amblyopia was altered. The subjects included 16 children and young adults with left eye amblyopia and 17 healthy controls (HCs). The abnormalities between the left/right primary visual cortex (PVC) and the other brain regions were investigated in a voxel-wise manner using the Granger causality analysis (GCA). According to the EC results in the HCs and the distribution of visual pathways, 12 regions of interest (ROIs) were selected to construct an EC network. The alteration of the EC network of the children and young adults with amblyopia was analyzed. In the voxel-wise manner analysis, amblyopia showed significantly decreased EC between the left/right of the PVC and the left middle frontal gyrus/left inferior frontal gyrus compared with the HCs. In the EC network analysis, compared with the HCs, amblyopia showed significantly decreased EC from the left calcarine fissure, posterior cingulate gyrus, left lingual gyrus, right lingual gyrus, and right fusiform gyrus to the right calcarine fissure. Amblyopia also showed significantly decreased EC from the right inferior frontal gyrus and right lingual gyrus to the left superior temporal gyrus compared with the HCs in the EC network analysis. The results may indicate that amblyopia altered the visual feedforward and feedback pathway, and amblyopia may have a greater relevance with the feedback pathway than the feedforward pathway. Amblyopia may also correlate with the feedforward of the third visual pathway.

Altered Spontaneous Brain Activity of Children with Unilateral Amblyopia: A Resting State fMRI Study.

Objective: This study is aimed at investigating differences in local brain activity and functional connectivity (FC) between children with unilateral amblyopia and healthy controls (HCs) by using resting state functional magnetic resonance imaging (rs-fMRI). Methods: Local activity and FC analysis methods were used to explore the altered spontaneous brain activity of children with unilateral amblyopia. Local brain function analysis methods included the amplitude of low-frequency fluctuation (ALFF). FC analysis methods consisted of the FC between the primary visual cortex (PVC-FC) and other brain regions and the FC network between regions of interest (ROIs-FC) selected by independent component analysis. Results: The ALFF in the bilateral frontal, temporal, and occipital lobes in the amblyopia group was lower than that in the HCs. The weakened PVC-FC was mainly concentrated in the frontal lobe and the angular gyrus. The ROIs-FC between the default mode network, salience network, and primary visual cortex network (PVCN) were significantly reduced, whereas the ROIs-FC between the PVCN and the high-level visual cortex network were significantly increased in amblyopia. Conclusions: Unilateral amblyopia may reduce local brain activity and FC in the dorsal and ventral visual pathways and affect the top-down attentional control. Amblyopia may also alter FC between brain functional networks. These findings may help understand the pathological mechanisms of children with amblyopia.

Retinal Fundus Image Enhancement Using the Normalized Convolution and Noise Removing.

Retinal fundus image plays an important role in the diagnosis of retinal related diseases. The detailed information of the retinal fundus image such as small vessels, microaneurysms, and exudates may be in low contrast, and retinal image enhancement usually gives help to analyze diseases related to retinal fundus image. Current image enhancement methods may lead to artificial boundaries, abrupt changes in color levels, and the loss of image detail. In order to avoid these side effects, a new retinal fundus image enhancement method is proposed. First, the original retinal fundus image was processed by the normalized convolution algorithm with a domain transform to obtain an image with the basic information of the background. Then, the image with the basic information of the background was fused with the original retinal fundus image to obtain an enhanced fundus image. Lastly, the fused image was denoised by a two-stage denoising method including the fourth order PDEs and the relaxed median filter. The retinal image databases, including the DRIVE database, the STARE database, and the DIARETDB1 database, were used to evaluate image enhancement effects. The results show that the method can enhance the retinal fundus image prominently. And, different from some other fundus image enhancement methods, the proposed method can directly enhance color images.

A New Approach to Segment Both Main and Peripheral Retinal Vessels Based on Gray-Voting and Gaussian Mixture Model.

Vessel segmentation in retinal fundus images is a preliminary step to clinical diagnosis for some systemic diseases and some eye diseases. The performances of existing methods for segmenting small vessels which are usually of more importance than the main vessels in a clinical diagnosis are not satisfactory in clinical use. In this paper, we present a method for both main and peripheral vessel segmentation. A local gray-level change enhancement algorithm called gray-voting is used to enhance the small vessels, while a two-dimensional Gabor wavelet is used to extract the main vessels. We fuse the gray-voting results with the 2D-Gabor filter results as pre-processing outcome. A Gaussian mixture model is then used to extract vessel clusters from the pre-processing outcome, while small vessels fragments are obtained using another gray-voting process, which complements the vessel cluster extraction already performed. At the last step, we eliminate the fragments that do not belong to the vessels based on the shape of the fragments. We evaluated the approach with two publicly available DRIVE (Staal et al., 2004) and STARE (Hoover et at., 2000) datasets with manually segmented results. For the STARE dataset, when using the second manually segmented results which include much more small vessels than the first manually segmented results as the "gold standard," this approach achieved an average sensitivity, accuracy and specificity of 65.0%, 92.1% and 97.0%, respectively. The sensitivities of this approach were much higher than those of the other existing methods, with comparable specificities; these results thus demonstrated that this approach was sensitive to detection of small vessels.

Constructing three-dimensional detachable and composable computer models of the head and neck.

The head and neck region has a complex spatial and topological structure, three-dimensional (3D) computer model of the region can be used in anatomical education, radiotherapy planning and surgical training. However, most of the current models only consist of a few parts of the head and neck, and the 3D models are not detachable and composable. In this study, a high-resolution 3D detachable and composable model of the head and neck was constructed based on computed tomography (CT) serial images. First, fine CT serial images of the head and neck were obtained. Then, a color lookup table was created for 58 structures, which was used to create anatomical atlases of the head and neck. Then, surface and volume rendering methods were used to reconstruct 3D models of the head and neck. Smoothing and polygon reduction steps were added to improve 3D rendering effects. 3D computer models of the head and neck, including the sinus, pharynx, vasculature, nervous system, endocrine system and glands, muscles, bones and skin, were reconstructed. The models consisted of 58 anatomical detachable and composable structures and each structure can be displayed individually or together with other structures.

[New Approach of Fundus Image Segmentation Evaluation Based on Topology Structure].

In view of the evaluation of fundus image segmentation, a new evaluation method was proposed to make up insufficiency of the traditional evaluation method which only considers the overlap of pixels and neglects topology structure of the retinal vessel. Mathematical morphology and thinning algorithm were used to obtain the retinal vascular topology structure. Then three features of retinal vessel, including mutual information, correlation coefficient and ratio of nodes, were calculated. The features of the thinned images taken as topology structure of blood vessel were used to evaluate retinal image segmentation. The manually-labeled images and their eroded ones of STARE database were used in the experiment. The result showed that these features, including mutual information, correlation coefficient and ratio of nodes, could be used to evaluate the segmentation quality of retinal vessel on fundus image through topology structure, and the algorithm was simple. The method is of significance to the supplement of traditional segmentation evaluation of retinal vessel on fundus image.

[The application of computer modeling in ophthalmologic investigation].

It is very difficult to measure the human eye properties directly, such as the accommodation mechanism, intraocular pressure distribution, the dynamics of aqueous humor flow and the bio-heat transfer in human eyes. Modeling and simulation may, therefore, play an increasingly important role in the ophthalmologic investigation. The major computer modeling methods, including geometric modeling, physical modeling and mathematical modeling, are introduced in this paper. Modeling and simulation anatomy properties and physiological properties of eye tissues, such as the cornea, aqueous humor and crystalline lens, vitreous, optic nerve head, sclera, are analyzed in the order from global to local, from front to back, from outside to inside. Finally, the problems of computer modeling in ophthalmologic investigation are discussed, and the development trends of the future are pointed out.

Constructing a computer model of the human eye based on tissue slice images.

Computer simulation of the biomechanical and biological heat transfer in ophthalmology greatly relies on having a reliable computer model of the human eye. This paper proposes a novel method on the construction of a geometric model of the human eye based on tissue slice images. Slice images were obtained from an in vitro Chinese human eye through an embryo specimen processing methods. A level set algorithm was used to extract contour points of eye tissues while a principle component analysis was used to detect the central axis of the image. The two-dimensional contour was rotated around the central axis to obtain a three-dimensional model of the human eye. Refined geometric models of the cornea, sclera, iris, lens, vitreous, and other eye tissues were then constructed with their position and ratio relationships kept intact. A preliminary study of eye tissue deformation in eye virtual surgery was simulated by a mass-spring model based on the computer models developed.