SFPFusion: An Improved Vision Transformer Combining Super Feature Attention and Wavelet-Guided Pooling for Infrared and Visible Images Fusion.

The infrared and visible image fusion task aims to generate a single image that preserves complementary features and reduces redundant information from different modalities. Although convolutional neural networks (CNNs) can effectively extract local features and obtain better fusion performance, the size of the receptive field limits its feature extraction ability. Thus, the Transformer architecture has gradually become mainstream to extract global features. However, current Transformer-based fusion methods ignore the enhancement of details, which is important to image fusion tasks and other downstream vision tasks. To this end, a new super feature attention mechanism and the wavelet-guided pooling operation are applied to the fusion network to form a novel fusion network, termed SFPFusion. Specifically, super feature attention is able to establish long-range dependencies of images and to fully extract global features. The extracted global features are processed by wavelet-guided pooling to fully extract multi-scale base information and to enhance the detail features. With the powerful representation ability, only simple fusion strategies are utilized to achieve better fusion performance. The superiority of our method compared with other state-of-the-art methods is demonstrated in qualitative and quantitative experiments on multiple image fusion benchmarks.

Experimental Observation of a Generalized Thouless Pump with a Single Spin.

Adiabatic cyclic modulation of a one-dimensional periodic potential will result in quantized charge transport, which is termed the Thouless pump. In contrast to the original Thouless pump restricted by the topology of the energy band, here we experimentally observe a generalized Thouless pump that can be extensively and continuously controlled. The extraordinary features of the new pump originate from interband coherence in nonequilibrium initial states, and this fact indicates that a quantum superposition of different eigenstates individually undergoing quantum adiabatic following can also be an important ingredient unavailable in classical physics. The quantum simulation of this generalized Thouless pump in a two-band insulator is achieved by applying delicate control fields to a single spin in diamond. The experimental results demonstrate all principal characteristics of the generalized Thouless pump. Because the pumping in our system is most pronounced around a band-touching point, this work also suggests an alternative means to detect quantum or topological phase transitions.