Robust superhydrophobic cotton fabric based on dual-sized silica particles with self-healing nature.

Improving the durability of wear-resistant superhydrophobic surfaces is crucial for their practical use. To tackle this, research is now delving into self-healing superhydrophobic surfaces. In our study, we developed superhydrophobic cotton fabrics by embedding nano-silica particles, micro-silica powder, and polydimethylsiloxane (PDMS) using a dipping method. This innovative design grants the SiO2/PDMS cotton fabric remarkable superhydrophobicity, reflected by a water contact angle of 155°. Moreover, the PDMS was stored in the amorphous areas of cellulose of cotton fabrics, attaching to the fiber surface and playing a role in connecting micro-blocks and nano-particles. This causes a self-diffusion of PDMS molecules in these fabrics, allowing the surface to regain its superhydrophobicity even after abrasion damage. Impressively, this self-healing property can be renewed at least 8 times, showcasing the fabric's resilience. Moreover, these superhydrophobic cotton fabrics exhibit outstanding self-cleaning abilities and repel various substances such as blood, milk, cola, and tea. This resilience, coupled with its simplicity, low cost-effectiveness, and eco-friendliness, makes this coating highly promising for applications across construction, chemical, and medical fields. Our study also delves into understanding the self-healing mechanism of the SiO2/PDMS cotton fabric, offering insights into their long-term performance and potential advancements in this field.

Towards ultra-low-cost smartphone microscopy.

The outbreak of COVID-19 exposed the inadequacy of our technical tools for home health surveillance, and recent studies have shown the potential of smartphones as a universal optical microscopic imaging platform for such applications. However, most of them use laboratory-grade optomechanical components and transmitted illuminations to ensure focus tuning capability and imaging quality, which keeps the cost of the equipment high. Here, we propose an ultra-low-cost solution for smartphone microscopy. To realize focus tunability, we designed a seesaw-like structure capable of converting large displacements on one side into small displacements on the other (reduced to ∼9.1%), which leverages the intrinsic flexibility of 3D printing materials. We achieved a focus-tuning accuracy of ∼5 𝜇m, which is 40 times higher than the machining accuracy of the 3D-printed lens holder itself. For microscopic imaging, we used an off-the-shelf smartphone camera lens as the objective and the built-in flashlight as the illumination. To compensate for the resulting image quality degradation, we developed a learning-based image enhancement method. We used the CycleGAN architecture to establish the mapping from smartphone microscope images to benchtop microscope images without pairing. We verified the imaging performance on different biomedical samples. Except for the smartphone, we kept the full costs of the device under 4 USD. We think these efforts to lower the costs of smartphone microscopes will benefit their applications in various scenarios, such as point-of-care testing, on-site diagnosis, and home health surveillance. RESEARCH HIGHLIGHTS: We propose a solution for ultra-low-cost smartphone microscopy. Utilizing the flexibility of 3D-printed material, we can achieve focusing accuracy of ∼5 𝜇m. Such a low-cost device will benefit point-of-care diagnosis and home health surveillance.

Cross-attention learning enables real-time nonuniform rotational distortion correction in OCT.

Nonuniform rotational distortion (NURD) correction is vital for endoscopic optical coherence tomography (OCT) imaging and its functional extensions, such as angiography and elastography. Current NURD correction methods require time-consuming feature tracking/registration or cross-correlation calculations and thus sacrifice temporal resolution. Here we propose a cross-attention learning method for the NURD correction in OCT. Our method is inspired by the recent success of the self-attention mechanism in natural language processing and computer vision. By leveraging its ability to model long-range dependencies, we can directly obtain the spatial correlation between OCT A-lines at any distance, thus accelerating the NURD correction. We develop an end-to-end stacked cross-attention network and design three types of optimization constraints. We compare our method with two traditional feature-based methods and a CNN-based method on two publicly-available endoscopic OCT datasets. We further verify the NURD correction performance of our method on 3D stent reconstruction using a home-built endoscopic OCT system. Our method achieves a ∼3 × speedup to real time (26 ± 3 fps), and superior correction performance.

PdCu nanoalloy decorated photocatalysts for efficient and selective oxidative coupling of methane in flow reactors.

Methane activation by photocatalysis is one of the promising sustainable technologies for chemical synthesis. However, the current efficiency and stability of the process are moderate. Herein, a PdCu nanoalloy (~2.3 nm) was decorated on TiO2, which works for the efficient, stable, and selective photocatalytic oxidative coupling of methane at room temperature. A high methane conversion rate of 2480 µmol g-1 h-1 to C2 with an apparent quantum efficiency of ~8.4% has been achieved. More importantly, the photocatalyst exhibits the turnover frequency and turnover number of 116 h-1 and 12,642 with respect to PdCu, representing a record among all the photocatalytic processes (λ > 300 nm) operated at room temperature, together with a long stability of over 112 hours. The nanoalloy works as a hole acceptor, in which Pd softens and weakens C-H bond in methane and Cu decreases the adsorption energy of C2 products, leading to the high efficiency and long-time stability.

Annotation-efficient learning for OCT segmentation.

Deep learning has been successfully applied to OCT segmentation. However, for data from different manufacturers and imaging protocols, and for different regions of interest (ROIs), it requires laborious and time-consuming data annotation and training, which is undesirable in many scenarios, such as surgical navigation and multi-center clinical trials. Here we propose an annotation-efficient learning method for OCT segmentation that could significantly reduce annotation costs. Leveraging self-supervised generative learning, we train a Transformer-based model to learn the OCT imagery. Then we connect the trained Transformer-based encoder to a CNN-based decoder, to learn the dense pixel-wise prediction in OCT segmentation. These training phases use open-access data and thus incur no annotation costs, and the pre-trained model can be adapted to different data and ROIs without re-training. Based on the greedy approximation for the k-center problem, we also introduce an algorithm for the selective annotation of the target data. We verified our method on publicly-available and private OCT datasets. Compared to the widely-used U-Net model with 100% training data, our method only requires ∼10% of the data for achieving the same segmentation accuracy, and it speeds the training up to ∼3.5 times. Furthermore, our proposed method outperforms other potential strategies that could improve annotation efficiency. We think this emphasis on learning efficiency may help improve the intelligence and application penetration of OCT-based technologies.

Development and Clinical Validation of Semi-Supervised Generative Adversarial Networks for Detection of Retinal Disorders in Optical Coherence Tomography Images Using Small Dataset.

PURPOSE: To develop and test semi-supervised generative adversarial networks (GANs) that detect retinal disorders on optical coherence tomography (OCT) images using a small-labeled dataset. METHODS: From a public database, we randomly chose a small supervised dataset with 400 OCT images (100 choroidal neovascularization, 100 diabetic macular edema, 100 drusen, and 100 normal) and assigned all other OCT images to unsupervised dataset (107,912 images without labeling). We adopted a semi-supervised GAN and a supervised deep learning (DL) model for automatically detecting retinal disorders from OCT images. The performance of the 2 models was compared in 3 testing datasets with different OCT devices. The evaluation metrics included accuracy, sensitivity, specificity, and the area under the receiver operating characteristic curves. RESULTS: The local validation dataset included 1000 images with 250 from each category. The independent clinical dataset included 366 OCT images using Cirrus OCT Shanghai Shibei Hospital and 511 OCT images using RTVue OCT from Xinhua Hospital respectively. The semi-supervised GANs classifier achieved better accuracy than supervised DL model (0.91 vs 0.86 for local cell validation dataset, 0.91 vs 0.86 in the Shanghai Shibei Hospital testing dataset, and 0.93 vs 0.92 in Xinhua Hospital testing dataset). For detecting urgent referrals (choroidal neo-vascularization and diabetic macular edema) from nonurgent referrals (drusen and normal) on OCT images, the semi-supervised GANs classifier also achieved better area under the receiver operating characteristic curves than supervised DL model (0.99 vs 0.97, 0.97 vs 0.96, and 0.99 vs 0.99, respectively). CONCLUSIONS: A semi-supervised GAN can achieve better performance than that of a supervised DL model when the labeled dataset is limited. The current study offers utility to various research and clinical studies using DL with relatively small datasets. Semi-supervised GANs can detect retinal disorders from OCT images using relatively small dataset.

Proxy-Bridged Image Reconstruction Network for Anomaly Detection in Medical Images.

Anomaly detection in medical images refers to the identification of abnormal images with only normal images in the training set. Most existing methods solve this problem with a self-reconstruction framework, which tends to learn an identity mapping and reduces the sensitivity to anomalies. To mitigate this problem, in this paper, we propose a novel Proxy-bridged Image Reconstruction Network (ProxyAno) for anomaly detection in medical images. Specifically, we use an intermediate proxy to bridge the input image and the reconstructed image. We study different proxy types, and we find that the superpixel-image (SI) is the best one. We set all pixels' intensities within each superpixel as their average intensity, and denote this image as SI. The proposed ProxyAno consists of two modules, a Proxy Extraction Module and an Image Reconstruction Module. In the Proxy Extraction Module, a memory is introduced to memorize the feature correspondence for normal image to its corresponding SI, while the memorized correspondence does not apply to the abnormal images, which leads to the information loss for abnormal image and facilitates the anomaly detection. In the Image Reconstruction Module, we map an SI to its reconstructed image. Further, we crop a patch from the image and paste it on the normal SI to mimic the anomalies, and enforce the network to reconstruct the normal image even with the pseudo abnormal SI. In this way, our network enlarges the reconstruction error for anomalies. Extensive experiments on brain MR images, retinal OCT images and retinal fundus images verify the effectiveness of our method for both image-level and pixel-level anomaly detection.

Memorizing Structure-Texture Correspondence for Image Anomaly Detection.

This work focuses on image anomaly detection by leveraging only normal images in the training phase. Most previous methods tackle anomaly detection by reconstructing the input images with an autoencoder (AE)-based model, and an underlying assumption is that the reconstruction errors for the normal images are small, and those for the abnormal images are large. However, these AE-based methods, sometimes, even reconstruct the anomalies well; consequently, they are less sensitive to anomalies. To conquer this issue, we propose to reconstruct the image by leveraging the structure-texture correspondence. Specifically, we observe that, usually, for normal images, the texture can be inferred from its corresponding structure (e.g., the blood vessels in the fundus image and the structured anatomy in optical coherence tomography image), while it is hard to infer the texture from a destroyed structure for the abnormal images. Therefore, a structure-texture correspondence memory (STCM) module is proposed to reconstruct image texture from its structure, where a memory mechanism is used to characterize the mapping from the normal structure to its corresponding normal texture. As the correspondence between destroyed structure and texture cannot be characterized by the memory, the abnormal images would have a larger reconstruction error, facilitating anomaly detection. In this work, we utilize two kinds of complementary structures (i.e., the semantic structure with human-labeled category information and the low-level structure with abundant details), which are extracted by two structure extractors. The reconstructions from the two kinds of structures are fused together by a learned attention weight to get the final reconstructed image. We further feed the reconstructed image into the two aforementioned structure extractors to extract structures. On the one hand, constraining the consistency between the structures extracted from the original input and that from the reconstructed image would regularize the network training; on the other hand, the error between the structures extracted from the original input and that from the reconstructed image can also be used as a supplement measurement to identify the anomaly. Extensive experiments validate the effectiveness of our method for image anomaly detection on both industrial inspection images and medical images.

A Novel Tumor Progression Prediction Method for Multimode Ablation Treatment.

OBJECTIVE: The multimode ablation of liver cancer, which uses radio-frequency heating after a pre-freezing process to treat the tumor, has shown significantly improved therapeutic effects and enhanced anti-tumor immune response. Unlike open surgery, the ablated lesions remain in the body after treatment, so it is critical to assess the immediate outcome and to monitor disease status over time. Here we propose a novel tumor progression prediction method for simultaneous postoperative evaluation and prognosis analysis. METHODS: We propose to leverage the intraoperative therapeutic information extracted from thermal dose distribution. For tumors with specific sensitivity reflected in medical images, different thermal doses implicitly indicate the degree of instant damage and long-term inhibition excited under specific ablation energy. We further propose a survival analysis framework for the multimode ablation treatment. It extracts carefully designed features from clinical, preoperative, intraoperative, and postoperative data, then uses random survival forest for feature selection and deep neural networks for survival prediction. RESULTS: We evaluated the proposed methods using clinical data. The results show that our method outperforms the state-of-the-art survival analysis methods with a C-index of 0.855±0.090. The thermal dose information contributes significantly to the prediction accuracy by taking up 21.7% of the overall feature importance. CONCLUSION: The proposed methods have been demonstrated to be a powerful tool in tumor progression prediction of multimode ablation therapy. SIGNIFICANCE: This kind of data-driven prognosis analysis may benefit personalized medicine and simplify the follow-up process.

Noise reduction by adaptive-SIN filtering for retinal OCT images.

Optical coherence tomography (OCT) images is widely used in ophthalmic examination, but their qualities are often affected by noises. Shearlet transform has shown its effectiveness in removing image noises because of its edge-preserving property and directional sensitivity. In the paper, we propose an adaptive denoising algorithm for OCT images. The OCT noise is closer to the Poisson distribution than the Gaussian distribution, and shearlet transform assumes additive white Gaussian noise. We hence propose a square-root transform to redistribute the OCT noise. Different manufacturers and differences between imaging objects may influence the observed noise characteristics, which make predefined thresholding scheme ineffective. We propose an adaptive 3D shearlet image filter with noise-redistribution (adaptive-SIN) scheme for OCT images. The proposed adaptive-SIN is evaluated on three benchmark datasets using quantitative evaluation metrics and subjective visual inspection. Compared with other algorithms, the proposed algorithm better removes noise in OCT images and better preserves image details, significantly outperforming in terms of both quantitative evaluation and visual inspection. The proposed algorithm effectively transforms the Poisson noise to Gaussian noise so that the subsequent shearlet transform could optimally remove the noise. The proposed adaptive thresholding scheme optimally adapts to various noise conditions and hence better remove the noise. The comparison experimental results on three benchmark datasets against 8 compared algorithms demonstrate the effectiveness of the proposed approach in removing OCT noise.

Detection of shallow anterior chamber depth from two-dimensional anterior segment photographs using deep learning.

BACKGROUND: The purpose of this study was to implement and evaluate a deep learning (DL) approach for automatically detecting shallow anterior chamber depth (ACD) from two-dimensional (2D) overview anterior segment photographs. METHODS: We trained a DL model using a dataset of anterior segment photographs collected from Shanghai Aier Eye Hospital from June 2018 to December 2019. A Pentacam HR system was used to capture a 2D overview eye image and measure the ACD. Shallow ACD was defined as ACD less than 2.4 mm. The DL model was evaluated by a five-fold cross-validation test in a hold-out testing dataset. We also evaluated the DL model by testing it against two glaucoma specialists. The performance of the DL model was calculated by metrics, including accuracy, sensitivity, specificity, and area under the receiver operating characteristic curve (AUC). RESULTS: A total of 3753 photographs (1720 shallow AC and 2033 deep AC images) were assigned to the training dataset, and 1302 photographs (509 shallow AC and 793 deep AC images) were held out for two internal testing datasets. In detecting shallow ACD in the internal hold-out testing dataset, the DL model achieved an AUC of 0.86 (95% CI, 0.83-0.90) with 80% sensitivity and 79% specificity. In the same testing dataset, the DL model also achieved better performance than the two glaucoma specialists (accuracy of 80% vs. accuracy of 74 and 69%). CONCLUSIONS: We proposed a high-performing DL model to automatically detect shallow ACD from overview anterior segment photographs. Our DL model has potential applications in detecting and monitoring shallow ACD in the real world. TRIAL REGISTRATION: http://clinicaltrials.gov , NCT04340635 , retrospectively registered on 29 March 2020.

Semi-supervised generative adversarial networks for closed-angle detection on anterior segment optical coherence tomography images: an empirical study with a small training dataset.

BACKGROUND: Semi-supervised learning algorithms can leverage an unlabeled dataset when labeling is limited or expensive to obtain. In the current study, we developed and evaluated a semi-supervised generative adversarial networks (GANs) model that detects closed-angle on anterior segment optical coherence tomography (AS-OCT) images using a small labeled dataset. METHODS: In this cross-sectional study, a semi-supervised GANs model was developed for automatic closed-angle detection training on a small labeled and large unsupervised training dataset collected from the Joint Shantou International Eye Center of Shantou University and the Chinese University of Hong Kong (JSIEC). The closed-angle was defined as iris-trabecular contact beyond the scleral spur in AS-OCT images. We further developed two supervised deep learning (DL) models training on the same supervised dataset and the whole dataset separately. The semi-supervised GANs model and supervised DL models' performance were compared on two independent testing datasets from JSIEC (515 images) and the Department of Ophthalmology (84 images), National University Health System, respectively. The diagnostic performance was assessed by evaluation matrices, including the accuracy, sensitivity, specificity, and area under the receiver operating characteristic curve (AUC). RESULTS: For closed-angle detection using clinician grading of AS-OCT imaging as the reference standard, the semi-supervised GANs model showed comparable performance, with AUCs of 0.97 (95% CI, 0.96-0.99) and 0.98 (95% CI, 0.94-1.00), compared with the supervised DL model (using the whole dataset) [AUCs of 0.97 (95% CI, 0.96-0.99), and 0.97 (95% CI, 0.94-1.00)]. When training on the same small supervised dataset, the semi-supervised GANs achieved performance at least as well as, if not better than, the supervised DL model [AUCs of 0.90 (95% CI: 0.84-0.96), and 0.92 (95% CI, 0.86-0.97)]. CONCLUSIONS: The semi-supervised GANs method achieves diagnostic performance at least as good as a supervised DL model when trained on small labeled datasets. Further development of semi-supervised learning methods could be useful within clinical and research settings. TRIAL REGISTRATION NUMBER: ChiCTR2000037892.

Ocular Anatomical and Functional Characteristics in Anisometropic Chinese Children.

SIGNIFICANCE: This research found that anterior and posterior biometrics differ in many aspects between fellow eyes of anisometropic children. This might shed light on the mechanisms underlying the onset and progression of anisometropia and myopia. PURPOSE: This study aimed to investigate the ocular biometric parameters, peripheral refraction, and accommodative lag of fellow eyes in anisometropic children. METHODS: Anisometropic children were recruited. Axial length (AL), vitreous chamber depth (VCD), central corneal thickness, anterior chamber depth (ACD), lens thickness (LT), simulated K readings, central and peripheral refractive errors, and accommodative lag were measured in both eyes. The subfoveal choroidal thickness, average choroidal thickness, and choroid vessel density of the 6 × 6-mm macular area were measured by optical coherence tomography. RESULTS: Thirty-two children aged 11.1 ± 1.7 years were enrolled. The average degree of anisometropia was 2.49 ± 0.88 D. The AL, VCD, ACD, and simulated K reading values were significantly larger in the more myopic eyes, whereas the LT value was significantly smaller. Subfoveal choroidal thickness (P = .001) and average choroidal thickness (P = .02) were smaller in the more myopic eyes than in the contralateral eyes, whereas choroid vessel density (P = .03) was larger. The amount of anisometropia had a significant positive correlation with the difference in AL (r = 0.869, P < .001), VCD (r = 0.853, P < .001), and ACD (r = 0.591, P < .001) and a negative correlation with the difference in LT (r = -0.457, P = .009). CONCLUSIONS: Ocular biometrics differ in many aspects between the fellow eyes of anisometropic Chinese children, and the difference is correlated with the degree of anisometropia.

Assessment of Generative Adversarial Networks for Synthetic Anterior Segment Optical Coherence Tomography Images in Closed-Angle Detection.

Purpose: To develop generative adversarial networks (GANs) that synthesize realistic anterior segment optical coherence tomography (AS-OCT) images and evaluate deep learning (DL) models that are trained on real and synthetic datasets for detecting angle closure. Methods: The GAN architecture was adopted and trained on the dataset with AS-OCT images collected from the Joint Shantou International Eye Center of Shantou University and the Chinese University of Hong Kong, synthesizing open- and closed-angle AS-OCT images. A visual Turing test with two glaucoma specialists was performed to assess the image quality of real and synthetic images. DL models, trained on either real or synthetic datasets, were developed. Using the clinicians' grading of the AS-OCT images as the reference standard, we compared the diagnostic performance of open-angle vs. closed-angle detection of DL models and the AS-OCT parameter, defined as a trabecular-iris space area 750 µm anterior to the scleral spur (TISA750), in a small independent validation dataset. Results: The GAN training included 28,643 AS-OCT anterior chamber angle (ACA) images. The real and synthetic datasets for DL model training have an equal distribution of open- and closed-angle images (all with 10,000 images each). The independent validation dataset included 238 open-angle and 243 closed-angle AS-OCT ACA images. The image quality of real versus synthetic AS-OCT images was similar, as assessed by the two glaucoma specialists, except for the scleral spur visibility. For the independent validation dataset, both DL models achieved higher areas under the curve compared with TISA750. Two DL models had areas under the curve of 0.97 (95% confidence interval, 0.96-0.99) and 0.94 (95% confidence interval, 0.92-0.96). Conclusions: The GAN synthetic AS-OCT images appeared to be of good quality, according to the glaucoma specialists. The DL models, trained on all-synthetic AS-OCT images, can achieve high diagnostic performance. Translational Relevance: The GANs can generate realistic AS-OCT images, which can also be used to train DL models.

CS2-Net: Deep learning segmentation of curvilinear structures in medical imaging.

Automated detection of curvilinear structures, e.g., blood vessels or nerve fibres, from medical and biomedical images is a crucial early step in automatic image interpretation associated to the management of many diseases. Precise measurement of the morphological changes of these curvilinear organ structures informs clinicians for understanding the mechanism, diagnosis, and treatment of e.g. cardiovascular, kidney, eye, lung, and neurological conditions. In this work, we propose a generic and unified convolution neural network for the segmentation of curvilinear structures and illustrate in several 2D/3D medical imaging modalities. We introduce a new curvilinear structure segmentation network (CS2-Net), which includes a self-attention mechanism in the encoder and decoder to learn rich hierarchical representations of curvilinear structures. Two types of attention modules - spatial attention and channel attention - are utilized to enhance the inter-class discrimination and intra-class responsiveness, to further integrate local features with their global dependencies and normalization, adaptively. Furthermore, to facilitate the segmentation of curvilinear structures in medical images, we employ a 1×3 and a 3×1 convolutional kernel to capture boundary features. Besides, we extend the 2D attention mechanism to 3D to enhance the network's ability to aggregate depth information across different layers/slices. The proposed curvilinear structure segmentation network is thoroughly validated using both 2D and 3D images across six different imaging modalities. Experimental results across nine datasets show the proposed method generally outperforms other state-of-the-art algorithms in various metrics.

ROSE: A Retinal OCT-Angiography Vessel Segmentation Dataset and New Model.

Optical Coherence Tomography Angiography (OCTA) is a non-invasive imaging technique that has been increasingly used to image the retinal vasculature at capillary level resolution. However, automated segmentation of retinal vessels in OCTA has been under-studied due to various challenges such as low capillary visibility and high vessel complexity, despite its significance in understanding many vision-related diseases. In addition, there is no publicly available OCTA dataset with manually graded vessels for training and validation of segmentation algorithms. To address these issues, for the first time in the field of retinal image analysis we construct a dedicated Retinal OCTA SEgmentation dataset (ROSE), which consists of 229 OCTA images with vessel annotations at either centerline-level or pixel level. This dataset with the source code has been released for public access to assist researchers in the community in undertaking research in related topics. Secondly, we introduce a novel split-based coarse-to-fine vessel segmentation network for OCTA images (OCTA-Net), with the ability to detect thick and thin vessels separately. In the OCTA-Net, a split-based coarse segmentation module is first utilized to produce a preliminary confidence map of vessels, and a split-based refined segmentation module is then used to optimize the shape/contour of the retinal microvasculature. We perform a thorough evaluation of the state-of-the-art vessel segmentation models and our OCTA-Net on the constructed ROSE dataset. The experimental results demonstrate that our OCTA-Net yields better vessel segmentation performance in OCTA than both traditional and other deep learning methods. In addition, we provide a fractal dimension analysis on the segmented microvasculature, and the statistical analysis demonstrates significant differences between the healthy control and Alzheimer's Disease group. This consolidates that the analysis of retinal microvasculature may offer a new scheme to study various neurodegenerative diseases.

High signal-to-noise ratio reconstruction of low bit-depth optical coherence tomography using deep learning.

SIGNIFICANCE: Reducing the bit depth is an effective approach to lower the cost of an optical coherence tomography (OCT) imaging device and increase the transmission efficiency in data acquisition and telemedicine. However, a low bit depth will lead to the degradation of the detection sensitivity, thus reducing the signal-to-noise ratio (SNR) of OCT images. AIM: We propose using deep learning to reconstruct high SNR OCT images from low bit-depth acquisition. APPROACH: The feasibility of our approach is evaluated by applying this approach to the quantized 3- to 8-bit data from native 12-bit interference fringes. We employ a pixel-to-pixel generative adversarial network (pix2pixGAN) architecture in the low-to-high bit-depth OCT image transition. RESULTS: Extensively, qualitative and quantitative results show our method could significantly improve the SNR of the low bit-depth OCT images. The adopted pix2pixGAN is superior to other possible deep learning and compressed sensing solutions. CONCLUSIONS: Our work demonstrates that the proper integration of OCT and deep learning could benefit the development of healthcare in low-resource settings.

Multi-scale U-net with Edge Guidance for Multimodal Retinal Image Deformable Registration.

Registration of multimodal retinal images is of great importance in facilitating the diagnosis and treatment of many eye diseases, such as the registration between color fundus images and optical coherence tomography (OCT) images. However, it is difficult to obtain ground truth, and most existing algorithms are for rigid registration without considering the optical distortion. In this paper, we present an unsupervised learning method for deformable registration between the two images. To solve the registration problem, the structure achieves a multi-level receptive field and takes contour and local detail into account. To measure the edge difference caused by different distortions in the optics center and edge, an edge similarity (ES) loss term is proposed, so loss function is composed by local cross-correlation, edge similarity and diffusion regularizer on the spatial gradients of the deformation matrix. Thus, we propose a multi-scale input layer, U-net with dilated convolution structure, squeeze excitation (SE) block and spatial transformer layers. Quantitative experiments prove the proposed framework is best compared with several conventional and deep learningbased methods, and our ES loss and structure combined with Unet and multi-scale layers achieve competitive results for normal and abnormal images.

Deep Learning with Skip Connection Attention for Choroid Layer Segmentation in OCT Images.

Since the thickness and shape of the choroid layer are indicators for the diagnosis of several ophthalmic diseases, the choroid layer segmentation is an important task. There exist many challenges in segmentation of the choroid layer. In this paper, in view of the lack of context information due to the ambiguous boundaries, and the subsequent inconsistent predictions of the same category targets ascribed to the lack of context information or the large regions, a novel Skip Connection Attention (SCA) module which is integrated into the U-Shape architecture is proposed to improve the precision of choroid layer segmentation in Optical Coherence Tomography (OCT) images. The main function of the SCA module is to capture the global context in the highest level to provide the decoder with stage-by-stage guidance, to extract more context information and generate more consistent predictions for the same class targets. By integrating the SCA module into the U-Net and CE-Net, we show that the module improves the accuracy of the choroid layer segmentation.

Automatic Segmentation and Visualization of Choroid in OCT with Knowledge Infused Deep Learning.

The choroid provides oxygen and nourishment to the outer retina thus is related to the pathology of various ocular diseases. Optical coherence tomography (OCT) is advantageous in visualizing and quantifying the choroid in vivo. However, its application in the study of the choroid is still limited for two reasons. (1) The lower boundary of the choroid (choroid-sclera interface) in OCT is fuzzy, which makes the automatic segmentation difficult and inaccurate. (2) The visualization of the choroid is hindered by the vessel shadows from the superficial layers of the inner retina. In this paper, we propose to incorporate medical and imaging prior knowledge with deep learning to address these two problems. We propose a biomarker-infused global-to-local network (Bio-Net) for the choroid segmentation, which not only regularizes the segmentation via predicted choroid thickness, but also leverages a global-to-local segmentation strategy to provide global structure information and suppress overfitting. For eliminating the retinal vessel shadows, we propose a deep-learning pipeline, which firstly locate the shadows using their projection on the retinal pigment epithelium layer, then the contents of the choroidal vasculature at the shadow locations are predicted with an edge-to-texture generative adversarial inpainting network. The results show our method outperforms the existing methods on both tasks. We further apply the proposed method in a clinical prospective study for understanding the pathology of glaucoma, which demonstrates its capacity in detecting the structure and vascular changes of the choroid related to the elevation of intra-ocular pressure.