Your browser doesn't support javascript.
loading
: 20 | 50 | 100
1 - 20 de 46
1.
Article En | MEDLINE | ID: mdl-38381635

multimodal image fusion involves tasks like pan-sharpening and depth super-resolution. Both tasks aim to generate high-resolution target images by fusing the complementary information from the texture-rich guidance and low-resolution target counterparts. They are inborn with reconstructing high-frequency information. Despite their inherent frequency domain connection, most existing methods only operate solely in the spatial domain and rarely explore the solutions in the frequency domain. This study addresses this limitation by proposing solutions in both the spatial and frequency domains. We devise a Spatial-Frequency Information Integration Network, abbreviated as SFINet for this purpose. The SFINet includes a core module tailored for image fusion. This module consists of three key components: a spatial-domain information branch, a frequency-domain information branch, and a dual-domain interaction. The spatial-domain information branch employs the spatial convolution-equipped invertible neural operators to integrate local information from different modalities in the spatial domain. Meanwhile, the frequency-domain information branch adopts a modality-aware deep Fourier transformation to capture the image-wide receptive field for exploring global contextual information. In addition, the dual-domain interaction facilitates information flow and the learning of complementary representations. We further present an improved version of SFINet, SFINet++, that enhances the representation of spatial information by replacing the basic convolution unit in the original spatial domain branch with the information-lossless invertible neural operator. We conduct extensive experiments to validate the effectiveness of the proposed networks and demonstrate their outstanding performance against state-of-the-art methods in two representative multimodal image fusion tasks: pan-sharpening and depth super-resolution. The source code is publicly available at https://github.com/manman1995/Awaresome-pansharpening.

3.
Neural Netw ; 170: 622-634, 2024 Feb.
Article En | MEDLINE | ID: mdl-38056409

Deep convolutional neural networks (DCNNs) have exhibited excellent feature extraction and detail reconstruction capabilities for single image super-resolution (SISR). Nevertheless, most previous DCNN-based methods do not fully utilize the complementary strengths between feature maps, channels, and pixels. Therefore, it hinders the ability of DCNNs to represent abundant features. To tackle the aforementioned issues, we present a Cascaded Visual Attention Network for SISR called CVANet, which simulates the visual attention mechanism of the human eyes to focus on the reconstruction process of details. Specifically, we first designed a trainable feature attention module (FAM) for feature-level attention learning. Afterward, we introduce a channel attention module (CAM) to reinforce feature maps under channel-level attention learning. Meanwhile, we propose a pixel attention module (PAM) that adaptively selects representative features from the previous layers, which are utilized to generate a high-resolution image. Satisfactory, our CVANet can effectively improve the resolution of images by exploring the feature representation capabilities of different modules and the visual perception properties of the human eyes. Extensive experiments with different methods on four benchmarks demonstrate that our CVANet outperforms the state-of-the-art (SOTA) methods in subjective visual perception, PSNR, and SSIM.The code will be made available https://github.com/WilyZhao8/CVANet.


Benchmarking , Visual Perception , Humans , Learning , Neural Networks, Computer , Image Processing, Computer-Assisted
4.
Int J Ophthalmol ; 16(10): 1608-1615, 2023.
Article En | MEDLINE | ID: mdl-37854373

AIM: To investigate the incidence of dry eye disease (DED) and relevant risk factors among patients infected with the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) Omicron variant. METHODS: This cross-sectional, observational analysis included 993 patients with corona virus disease 2019 (COVID-19) treated at the National Exhibition and Convention Center (Shanghai) Fangcang Shelter Hospital, from April 10 to May 26, 2022. Totally 944 uninfected control participants were recruited. All participants completed ocular surface disease index (OSDI) questionnaires, and DED symptoms were determined using OSDI scores. The demographic characteristics, length of hospital stay and in nasopharyngeal swabs were performed using questionnaires. SARS-CoV-2 Omicron variant infection was confirmed by nucleic acid-based detection in nasopharyngeal swabs using a 2019-nCoV nucleic acid detection kit. The risk factors for DED symptoms among patients with COVID-19 and control participants were determined by logistic regression analysis. RESULTS: Patients with COVID-19 showed a higher incidence of DED than controls (64.9% vs 55.1%, P<0.001). SARS-CoV-2 infection [odds ratios (ORs) (95%CI): 1.271 (1.038, 1.556)], use of contact lenses [ORs (95%CI): 9.350 (3.676, 23.783)], history of corneal refractive surgery [ORs (95%CI): 2.047 (1.494, 2.804)], poor sleep quality [ORs (95%CI): 2.657 (2.029, 3.480)], and video display terminal (VDT) use for more than 8h per day [ORs (95%CI): 6.348 (4.720, 8.538)] were found to be risk factors for DED symptoms in patients with COVID-19 as well as controls. For patients with COVID-19, the length of hospital stay [ORs (95%CI): 1.196 (1.134, 1.262)], use of contact lenses [ORs (95%CI): 20.423 (2.680, 155.632)], history of corneal refractive surgery [ORs (95%CI): 2.166 (1.321, 3.553)], poor sleep quality [ORs (95%CI): 3.650 (2.381, 5.597)], and VDT use for more than 8h per day [ORs (95%CI): 7.740 (4.918, 12.180)] were significant risk factors for DED symptoms. CONCLUSION: Patients with COVID-19 are more prone to develop symptomatic DED. SARS-CoV-2 infection and length of hospital stay are important risk factors for DED symptoms.

5.
Adv Ophthalmol Pract Res ; 3(4): 153-158, 2023.
Article En | MEDLINE | ID: mdl-37846317

Purpose: To explore the effect of the variation of pupil diameter (PD) and intraocular pressure (IOP) induced by femtosecond laser treatment on the subsequent phacoemulsfication and intraocular lens implantation. And whether the application of 0.1% pranoprofen could significantly reduce the miosis and increased IOP caused by femtosecond laser treatment in femtosecond laser-assisted cataract surgery (FLACS). Methods: In this study, patients were pretreated with (trial group) or without (control group) topical 0.1% pranoprofen. The PD and IOP were measured at different time points within 30 â€‹min after the completion of the femtosecond laser treatment. Results: The comparisons of the two groups showed the PD of patients pretreated with 0.1% pranoprofen was significantly larger than that of the control only at 15 â€‹min after FLACS (P â€‹= â€‹0.046), and there was no significant difference in IOP at any time point (P â€‹> â€‹0.05). Neither the ratio of significant miosis (PD â€‹≤ â€‹5 â€‹mm) nor intraocular hypertension (IOP ≥30 â€‹mmHg) was significantly different between the control group (1.72%, 6.67%) and the trial group (1%, 4.17%) (P â€‹> â€‹0.05). Conclusions: The PD and IOP of patients undergoing FLACS showed fluctuations within a small range. The rates of significant miosis and intraocular hypertension are very low, it is safe for surgeons to complete the follow-up procedures within 30 â€‹min after femtosecond laser treatment. Pretreatment with 0.1% pranoprofen exerted a slight, albeit significant prophylactic effect preventing pupil miosis. However, it provided only a limited benefit in patients undergoing FLACS without other complications.

6.
Exp Eye Res ; 234: 109597, 2023 09.
Article En | MEDLINE | ID: mdl-37490993

Proliferative diabetic retinopathy (PDR) adversely affects visual function. Extracellular matrix proteins (ECM) contribute significantly to the development of PDR. A Disintegrin and Metalloproteinase with Thrombospondin motifs 5 (ADAMTS5) is a member of ECM proteins. ADAMTS5 participates in angiogenesis and inflammation in diverse diseases. However, the role of ADAMTS5 in PDR remains elusive. Multiplex beam array technology was used to analyze vitreous humor of PDR patients and normal people. ELISA and Western blot were used to detect the expression of ADAMTS5, PEDF and autophagy related factors. Immunofluorescence assay was used to mark the expression and localization of ADAMTS5 and PEDF. The neovascularization was detected by tube formation test. Our results revealed that ADAMTS5 expression was increased in the vitreous humor of PDR patients and oxygen-induced retinopathy (OIR) mice retinas. Inhibiting ADAMTS5 alleviated pathological angiogenesis and upregulated PEDF expression in the OIR mice. In addition, ADAMTS5 inhibited PEDF secretion in ARPE-19 cells in vitro studies, thereby inhibiting the migration of HMEC-1. Mechanically, ADAMTS5 promoted the autophagic degradation of PEDF. Collectively, inhibition of ADAMTS5 during OIR suppresses pathological angiogenesis. Our study provides a new approach for resolving pathological angiogenesis in PDR.


Diabetes Mellitus , Diabetic Retinopathy , Retinal Diseases , Retinal Neovascularization , Serpins , Animals , Mice , Autophagy , Diabetic Retinopathy/metabolism , Eye Proteins/metabolism , Neovascularization, Pathologic , Retinal Neovascularization/metabolism , Serpins/metabolism
7.
IEEE Trans Image Process ; 32: 4472-4485, 2023.
Article En | MEDLINE | ID: mdl-37335801

Due to the light absorption and scattering induced by the water medium, underwater images usually suffer from some degradation problems, such as low contrast, color distortion, and blurring details, which aggravate the difficulty of downstream underwater understanding tasks. Therefore, how to obtain clear and visually pleasant images has become a common concern of people, and the task of underwater image enhancement (UIE) has also emerged as the times require. Among existing UIE methods, Generative Adversarial Networks (GANs) based methods perform well in visual aesthetics, while the physical model-based methods have better scene adaptability. Inheriting the advantages of the above two types of models, we propose a physical model-guided GAN model for UIE in this paper, referred to as PUGAN. The entire network is under the GAN architecture. On the one hand, we design a Parameters Estimation subnetwork (Par-subnet) to learn the parameters for physical model inversion, and use the generated color enhancement image as auxiliary information for the Two-Stream Interaction Enhancement sub-network (TSIE-subnet). Meanwhile, we design a Degradation Quantization (DQ) module in TSIE-subnet to quantize scene degradation, thereby achieving reinforcing enhancement of key regions. On the other hand, we design the Dual-Discriminators for the style-content adversarial constraint, promoting the authenticity and visual aesthetics of the results. Extensive experiments on three benchmark datasets demonstrate that our PUGAN outperforms state-of-the-art methods in both qualitative and quantitative metrics. The code and results can be found from the link of https://rmcong.github.io/proj_PUGAN.html.

8.
Cell Mol Biol (Noisy-le-grand) ; 69(3): 145-149, 2023 Mar 31.
Article En | MEDLINE | ID: mdl-37300675

The objective of this study was to investigate the effect of propofol on kidney renal clear cell carcinoma (KIRC) by regulating hypoxia-inducible factor-1α (HIF-1α) expression and silencing signal regulatory factor 1 (SIRT1) signal pathway. In this regard, human KIRC cell line RCC4 was added into 0, 5 and 10 µ G/ml propofol treatment and was divided into a control group (CG), low dose group (LG) and high dose group (HG). CCK8 was used to detect the proliferative ability of the three groups of cells, ELISA was used to detect the level of inflammatory factors in the cells, Western blot was used to detect the protein expression, qPCR was used to detect the related mRNA expression level, and Transwell method was used to detect the invasive ability of the cells in vitro. The experimental results showed that propofol decreased the proliferation and invasion ability of KIRC cells, up-regulated the expression of TGF- ß 1, IL-6, TNF- α, HIF-1 α, Fas, bax and FasL, and down-regulated the expression of SIRT1 in a dose-dependent manner. It was concluded that propofol can inhibit the SIRT1 signal pathway by up-regulating the level of HIF-1α in KIRC, which can significantly decrease the proliferation and invasion ability of KIRC cells, induce apoptosis and increase the release of intracellular inflammatory factors.


Carcinoma, Renal Cell , Kidney Neoplasms , Propofol , Humans , Propofol/pharmacology , Sirtuin 1/genetics , Hypoxia-Inducible Factor 1, alpha Subunit/genetics , Signal Transduction , Carcinoma, Renal Cell/drug therapy , Carcinoma, Renal Cell/genetics , Kidney Neoplasms/drug therapy , Kidney Neoplasms/genetics , Kidney , Cell Line, Tumor
9.
Article En | MEDLINE | ID: mdl-37379187

It is generally known that pan-sharpening is fundamentally a PAN-guided multispectral (MS) image super-resolution problem that involves learning the nonlinear mapping from low-resolution (LR) to high-resolution (HR) MS images. Since an infinite number of HR-MS images can be downsampled to produce the same corresponding LR-MS image, learning the mapping from LR-MS to HR-MS image is typically ill-posed and the space of the possible pan-sharpening functions can be extremely large, making it difficult to estimate the optimal mapping solution. To address the above issue, we propose a closed-loop scheme that learns the two opposite mapping including the pan-sharpening and its corresponding degradation process simultaneously to regularize the solution space in a single pipeline. More specifically, an invertible neural network (INN) is introduced to perform a bidirectional closed-loop: the forward operation for LR-MS pan-sharpening and the backward operation for learning the corresponding HR-MS image degradation process. In addition, given the vital importance of high-frequency textures for the Pan-sharpened MS images, we further strengthen the INN by designing a specified multiscale high-frequency texture extraction module. Extensive experimental results demonstrate that the proposed algorithm performs favorably against state-of-the-art methods qualitatively and quantitatively with fewer parameters. Ablation studies also verify the effectiveness of the closed-loop mechanism in pan-sharpening. The source code is made publicly available at https://github.com/manman1995/pan-sharpening-Team-zhouman/.

10.
Exp Hematol Oncol ; 12(1): 7, 2023 Jan 12.
Article En | MEDLINE | ID: mdl-36635765

BACKGROUND: Caspase-8 (Casp8) acts as an initiator in cell apoptosis signaling. However, the role of Casp8 in tuning the tumor immune microenvironment remains controversial due to the complicated crosstalk between immune-tolerogenic apoptotic cell death and immunogenic cell death cascades. METHODS: The Cancer Genome Atlas (TCGA) and publicly accessible immune checkpoint blockade (ICB)-treated cohorts were used to investigate the clinical relevance of Casp8. A tumor-bearing mouse model was used to characterize changes in the tumor microenvironment and to explore the efficacy of ICB treatment under Casp8 knockout conditions. RESULTS: By exploring TCGA datasets, we showed that the expression level of Casp8 was associated with an immuno-hot microenvironment across various solid tumor types. Casp8 deficiency leads to decreased CD8+ T cell infiltration and resistance to anti-PD-L1 therapy in a mouse model. Mechanistically, Casp8 deficiency or pharmacological disruption results in impaired ecto-calreticulin transition in tumor cells, which in turn hampers antigen presentation in draining lymph nodes. Furthermore, radiotherapy restored sensitivity to anti-PD-L1 treatment via elevated calreticulin surface expression. CONCLUSIONS: Our data revealed a causative role of Casp8 in modulating the immunogenicity of tumor cells and responsiveness to ICB immunotherapies and proposed radiotherapy as a salvage approach to overcome Casp8 deficiency-mediated ICB resistance.

11.
J Alzheimers Dis ; 91(3): 1097-1105, 2023.
Article En | MEDLINE | ID: mdl-36565122

BACKGROUND: The association between cataracts and cognitive functions has been reported in several studies. However, the dynamic trajectories of cognitive changes in patients with cataracts remain unelucidated. OBJECTIVE: The aim of the study was to evaluate the dynamic trajectories of cognitive changes in patients with cataracts. METHODS: This observational cohort study recruited 1,146 patients with age-related cataracts (ARC) from the Department of Ophthalmology, Daping Hospital, from September 2020 to November 2021. The cognitive functions of the patients were assessed using a Chinese version of the Telephone Interview of Cognitive Status-40 (TICS-40) test at baseline and 6 months of follow-up. The trajectories and the associated risk factors for the longitudinal cognitive decline during the 6-month follow-up were investigated. RESULTS: Patients with severe ARC [median (IQR): 0 month, 24 (22, 25); 6 months, 23 (21,25)] had lower TICS-40 scores than those with non-severe ARC [0 month, 31 (24, 33), p < 0.001; 6 months, 31 (23,33), p < 0.001] and controls [0 month, 32 (28, 35), p < 0.001; 6 months, 32 (28, 35), p < 0.001] at both baseline and 6 months of follow-up. Age (OR: 1.311, 95% CI: 1.229 to 1.398) and cataract grade (OR: 5.569, 95% CI: 2.337 to 13.273) were found to be the risk factors of cognitive decline as indicated by a decrease in the TICS-40 scores. CONCLUSION: ARC is associated with an increased risk of longitudinal cognitive decline; however, the reversibility of such declines needs to be investigated further.


Cataract , Cognitive Dysfunction , Humans , Aged , Longitudinal Studies , Cohort Studies , Cognition , Cataract/complications , Cataract/epidemiology , Cognitive Dysfunction/epidemiology , Cognitive Dysfunction/psychology
12.
IEEE Trans Cybern ; 53(3): 1920-1931, 2023 Mar.
Article En | MEDLINE | ID: mdl-35867373

The goal of co-salient object detection (CoSOD) is to discover salient objects that commonly appear in a query group containing two or more relevant images. Therefore, how to effectively extract interimage correspondence is crucial for the CoSOD task. In this article, we propose a global-and-local collaborative learning (GLNet) architecture, which includes a global correspondence modeling (GCM) and a local correspondence modeling (LCM) to capture the comprehensive interimage corresponding relationship among different images from the global and local perspectives. First, we treat different images as different time slices and use 3-D convolution to integrate all intrafeatures intuitively, which can more fully extract the global group semantics. Second, we design a pairwise correlation transformation (PCT) to explore similarity correspondence between pairwise images and combine the multiple local pairwise correspondences to generate the local interimage relationship. Third, the interimage relationships of the GCM and LCM are integrated through a global-and-local correspondence aggregation (GLA) module to explore more comprehensive interimage collaboration cues. Finally, the intra and inter features are adaptively integrated by an intra-and-inter weighting fusion (AEWF) module to learn co-saliency features and predict the co-saliency map. The proposed GLNet is evaluated on three prevailing CoSOD benchmark datasets, demonstrating that our model trained on a small dataset (about 3k images) still outperforms 11 state-of-the-art competitors trained on some large datasets (about 8k-200k images).

13.
IEEE Trans Image Process ; 31: 6800-6815, 2022.
Article En | MEDLINE | ID: mdl-36288228

Focusing on the issue of how to effectively capture and utilize cross-modality information in RGB-D salient object detection (SOD) task, we present a convolutional neural network (CNN) model, named CIR-Net, based on the novel cross-modality interaction and refinement. For the cross-modality interaction, 1) a progressive attention guided integration unit is proposed to sufficiently integrate RGB-D feature representations in the encoder stage, and 2) a convergence aggregation structure is proposed, which flows the RGB and depth decoding features into the corresponding RGB-D decoding streams via an importance gated fusion unit in the decoder stage. For the cross-modality refinement, we insert a refinement middleware structure between the encoder and the decoder, in which the RGB, depth, and RGB-D encoder features are further refined by successively using a self-modality attention refinement unit and a cross-modality weighting refinement unit. At last, with the gradually refined features, we predict the saliency map in the decoder stage. Extensive experiments on six popular RGB-D SOD benchmarks demonstrate that our network outperforms the state-of-the-art saliency detectors both qualitatively and quantitatively. The code and results can be found from the link of https://rmcong.github.io/proj_CIRNet.html.

14.
Transpl Immunol ; 75: 101708, 2022 12.
Article En | MEDLINE | ID: mdl-36103909

OBJECTIVE: Sevoflurane is used in anesthesia for surgery including in organ transplantation. We investigated the role of a non-coding single-stranded microRNA, miR-495-3p, in the sevoflurane-induced neurotoxicity using a mouse hippocampal neuronal cell line (HT22). METHODS: The levels of miR-495-3p in sevoflurane-exposed mice and HT22 cells were determined via RT-qPCR. The role of miR-495-3p on cell viability and apoptosis were determined by CCK-8 and flow cytometric assay, respectively. Western blotting was explored to measure levels of Bax, Bcl-2, active caspase 3, BDNF, p-ERK/ERK and p-CREB/CREB in HT22 cells. ELISA assay was used to examine the levels of reactive oxygen species (ROS), superoxide dismutase (SOD) and glutathione peroxidase (GPX) in cells. Dual luciferase reporter assay was used to explore the interaction of miR-495-3p and BDNF. RESULTS: The level of miR-495-3p was increased sevoflurane-exposed mice and in sevoflurane-treated HT22 cells. Downregulation of miR-495-3p inhibited sevoflurane-induced apoptosis and promoted cell proliferation by upregulating the proteins of Bcl-2 and downregulating the expressions of Bax and active caspase-3 in HT22 cells. In addition, inhibition of miR-495-3p alleviated sevoflurane-induced oxidative injuries in HT22 cells via decline of ROS and upregulation of SOD and GPX. MiR-495-3p can inhibit the ERK/CREB pathway by targeting BDNF. CONCLUSION: Downregulation of miR-495-3p can decrease oxidative status in HT22 cells and alleviate sevoflurane-induced cytotoxicity through stimulating the BDNF/ERK/CREB pathway.


Brain-Derived Neurotrophic Factor , MicroRNAs , Sevoflurane/pharmacology , Brain-Derived Neurotrophic Factor/genetics , Reactive Oxygen Species , bcl-2-Associated X Protein , Signal Transduction , Apoptosis , MicroRNAs/genetics , Superoxide Dismutase/metabolism
15.
IEEE Trans Image Process ; 31: 5442-5455, 2022.
Article En | MEDLINE | ID: mdl-35947571

Underwater image enhancement aims at improving the visibility and eliminating color distortions of underwater images degraded by light absorption and scattering in water. Recently, retinex variational models show remarkable capacity of enhancing images by estimating reflectance and illumination in a retinex decomposition course. However, ambiguous details and unnatural color still challenge the performance of retinex variational models on underwater image enhancement. To overcome these limitations, we propose a hyper-laplacian reflectance priors inspired retinex variational model to enhance underwater images. Specifically, the hyper-laplacian reflectance priors are established with the l1/2 -norm penalty on first-order and second-order gradients of the reflectance. Such priors exploit sparsity-promoting and complete-comprehensive reflectance that is used to enhance both salient structures and fine-scale details and recover the naturalness of authentic colors. Besides, the l2 norm is found to be suitable for accurately estimating the illumination. As a result, we turn a complex underwater image enhancement issue into simple subproblems that separately and simultaneously estimate the reflection and the illumination that are harnessed to enhance underwater images in a retinex variational model. We mathematically analyze and solve the optimal solution of each subproblem. In the optimization course, we develop an alternating minimization algorithm that is efficient on element-wise operations and independent of additional prior knowledge of underwater conditions. Extensive experiments demonstrate the superiority of the proposed method in both subjective results and objective assessments over existing methods. The code is available at: https://github.com/zhuangpeixian/HLRP.

16.
Article En | MEDLINE | ID: mdl-35657839

Underwater images typically suffer from color deviations and low visibility due to the wavelength-dependent light absorption and scattering. To deal with these degradation issues, we propose an efficient and robust underwater image enhancement method, called MLLE. Specifically, we first locally adjust the color and details of an input image according to a minimum color loss principle and a maximum attenuation map-guided fusion strategy. Afterward, we employ the integral and squared integral maps to compute the mean and variance of local image blocks, which are used to adaptively adjust the contrast of the input image. Meanwhile, a color balance strategy is introduced to balance the color differences between channel a and channel b in the CIELAB color space. Our enhanced results are characterized by vivid color, improved contrast, and enhanced details. Extensive experiments on three underwater image enhancement datasets demonstrate that our method outperforms the state-of-the-art methods. Our method is also appealing in its fast processing speed within 1s for processing an image of size 1024×1024×3 on a single CPU. Experiments further suggest that our method can effectively improve the performance of underwater image segmentation, keypoint detection, and saliency detection. The project page is available at https://li-chongyi.github.io/proj_MMLE.html.

17.
IEEE Trans Image Process ; 31: 4856-4868, 2022.
Article En | MEDLINE | ID: mdl-35709110

The new trend of full-screen devices encourages manufacturers to position a camera behind a screen, i.e., the newly-defined Under-Display Camera (UDC). Therefore, UDC image restoration has been a new realistic single image enhancement problem. In this work, we propose a curve estimation network operating on the hue (H) and saturation (S) channels to perform adaptive enhancement for degraded images captured by UDCs. The proposed network aims to match the complicated relationship between the images captured by under-display and display-free cameras. To extract effective features, we cascade the proposed curve estimation network with sharing weights, and we introduce a spatial and channel attention module in each curve estimation network to exploit attention-aware features. In addition, we learn the curve estimation network in a semi-supervised manner to alleviate the restriction of the requirement for amounts of labeled images and improve the generalization ability for unseen degraded images in various realistic scenes. The semi-supervised network consists of a supervised branch trained on labeled data and an unsupervised branch trained on unlabeled data. To train the proposed model, we build a new dataset comprised of real-world labeled and unlabeled images. Extensive experiments demonstrate that our proposed algorithm performs favorably against state-of-the-art image enhancement methods for UDC images in terms of accuracy and speed, especially on ultra-high-definition (UHD) images.

18.
IEEE Trans Pattern Anal Mach Intell ; 44(8): 4225-4238, 2022 Aug.
Article En | MEDLINE | ID: mdl-33656989

This paper presents a novel method, Zero-Reference Deep Curve Estimation (Zero-DCE), which formulates light enhancement as a task of image-specific curve estimation with a deep network. Our method trains a lightweight deep network, DCE-Net, to estimate pixel-wise and high-order curves for dynamic range adjustment of a given image. The curve estimation is specially designed, considering pixel value range, monotonicity, and differentiability. Zero-DCE is appealing in its relaxed assumption on reference images, i.e., it does not require any paired or even unpaired data during training. This is achieved through a set of carefully formulated non-reference loss functions, which implicitly measure the enhancement quality and drive the learning of the network. Despite its simplicity, we show that it generalizes well to diverse lighting conditions. Our method is efficient as image enhancement can be achieved by an intuitive and simple nonlinear curve mapping. We further present an accelerated and light version of Zero-DCE, called Zero-DCE++, that takes advantage of a tiny network with just 10K parameters. Zero-DCE++ has a fast inference speed (1000/11 FPS on a single GPU/CPU for an image of size 1200×900×3) while keeping the enhancement performance of Zero-DCE. Extensive experiments on various benchmarks demonstrate the advantages of our method over state-of-the-art methods qualitatively and quantitatively. Furthermore, the potential benefits of our method to face detection in the dark are discussed. The source code is made publicly available at https://li-chongyi.github.io/Proj_Zero-DCE++.html.

19.
IEEE Trans Pattern Anal Mach Intell ; 44(12): 9396-9416, 2022 Dec.
Article En | MEDLINE | ID: mdl-34752382

Low-light image enhancement (LLIE) aims at improving the perception or interpretability of an image captured in an environment with poor illumination. Recent advances in this area are dominated by deep learning-based solutions, where many learning strategies, network structures, loss functions, training data, etc. have been employed. In this paper, we provide a comprehensive survey to cover various aspects ranging from algorithm taxonomy to unsolved open issues. To examine the generalization of existing methods, we propose a low-light image and video dataset, in which the images and videos are taken by different mobile phones' cameras under diverse illumination conditions. Besides, for the first time, we provide a unified online platform that covers many popular LLIE methods, of which the results can be produced through a user-friendly web interface. In addition to qualitative and quantitative evaluation of existing methods on publicly available and our proposed datasets, we also validate their performance in face detection in the dark. This survey together with the proposed dataset and online platform could serve as a reference source for future study and promote the development of this research field. The proposed platform and dataset as well as the collected methods, datasets, and evaluation metrics are publicly available and will be regularly updated. Project page: https://www.mmlab-ntu.com/project/lliv_survey/index.html.

20.
Pharmaceuticals (Basel) ; 16(1)2022 Dec 25.
Article En | MEDLINE | ID: mdl-36678523

Nanoparticle-based drug delivery systems, which can overcome the challenges associated with poor aqueous solubility and other harmful side effects of drugs, display potent applications in cataract treatment. Herein, we designed a nanosystem of gold nanoparticles containing resveratrol (RGNPs) as an anti-aging agent to delay cataracts. The spherical RGNPs had a superior ability to inhibit hydrogen peroxide-mediated oxidative stress damage, including reactive oxygen species (ROS) production, malondialdehyde (MDA) generation, and glutathione (GSH) consumption in the lens epithelial cells. Additionally, the present data showed that RGNPs could delay cellular senescence induced by oxidative stress by decreasing the protein levels of p16 and p21, reducing the ratio of BAX/BCL-2 and the senescence-associated secretory phenotype (SASP) in vitro. Moreover, the RGNPs could also clearly relieve sodium selenite-induced lens opacity in a rat cataract model. Our data indicated that cell senescence was reduced and cataracts were delayed upon treatment with RGNPs through activating the Sirt1/Nrf2 signaling pathway. Our findings suggested that RGNPs could serve as an anti-aging ingredient, highlighting their potential to delay cataract development.

...