Non-local degradation modeling for spatially adaptive single image super-resolution.

Existing methods for single image super-resolution (SISR) model the blur kernel as spatially invariant across the entire image, and are susceptible to the adverse effects of textureless patches. To achieve improved results, adaptive estimation of the degradation kernel is necessary. We explore the synergy of joint global and local degradation modeling for spatially adaptive blind SISR. Our model, named spatially adaptive network for blind super-resolution (SASR), employs a simple encoder to estimate global degradation representations and a decoder to extract local degradation. These two representations are fused with a cross-attention mechanism and applied using spatially adaptive filtering to enhance the local image detail. Specifically, SASR contains two novel features: (1) a non-local degradation modeling with contrastive learning to learn global and local degradation representations, and (2) a non-local spatially adaptive filtering module (SAFM) that incorporates the global degradation and spatial-detail factors to preserve and enhance local details. We demonstrate that SASR can efficiently estimate degradation representations and handle multiple types of degradation. The local representations avoid the detrimental effect of estimating the entire super-resolved image with only one kernel through locally adaptive adjustments. Extensive experiments are performed to quantitatively and qualitatively demonstrate that SASR not only performs favorably for degradation estimation but also leads to state-of-the-art blind SISR performance when compared to alternative approaches.

Frequency-Aware Degradation Modeling for Real-World Thermal Image Super-Resolution.

The supervised super-resolution (SR) methods based on simple degradation assumptions (e.g., bicubic downsampling) have unsatisfactory generalization ability on real-world thermal images. To enhance the SR effect of real-world sceneries, we introduce an unsupervised SR framework for thermal images, incorporating degradation modeling and corresponding SR. Inspired by the physical prior that high frequency affects details and low frequency affects thermal contrast, we propose a frequency-aware degradation model, named TFADGAN. The model achieves image quality migration between thermal detectors of different resolutions by degrading different frequency components of the image from high-resolution (HR) to low-resolution (LR). Specifically, by adversarial learning with unpaired LR thermal images, the complex degradation processes of HR thermal images at low and high frequencies are modeled separately. Benefiting from the thermal characteristics mined from real-world images, the degraded images generated by TFADGAN are similar to LR thermal ones in terms of detail and contrast. Then, the SR model is trained based on the pseudo-paired data consisting of degraded images and HR images. Extensive experimental results demonstrate that the degraded images generated by TFADGAN provide reliable alternatives to real-world LR thermal images. In real-world thermal image experiments, the proposed SR framework can improve the peak signal-to-noise ratio (PSNR) and structural similarity degree (SSIM) by 1.28 dB and 0.02, respectively.

Remaining Useful Life Prediction for Two-Phase Nonlinear Degrading Systems with Three-Source Variability.

Recently, the estimation of remaining useful life (RUL) for two-phase nonlinear degrading devices has shown rising momentum for ensuring their safe and reliable operation. The degradation processes of such systems are influenced by the temporal variability, unit-to-unit variability, and measurement variability jointly. However, current studies only consider these three sources of variability partially. To this end, this paper presents a two-phase nonlinear degradation model with three-source variability based on the nonlinear Wiener process. Then, the approximate analytical solution of the RUL with three-source variability is derived under the concept of the first passage time (FPT). For better implementation, the offline model parameter estimation is conducted by the maximum likelihood estimation (MLE), and the Bayesian rule in conjunction with the Kalman filtering (KF) algorithm are utilized for the online model updating. Finally, the effectiveness of the proposed approach is validated through a numerical example and a practical case study of the capacitor degradation data. The results show that it is necessary to incorporate three-source variability simultaneously into the RUL prediction of the two-phase nonlinear degrading systems.