Multispectral imaging via nanostructured random broadband filtering.

It is a challenge to acquire a snapshot image of very high resolutions in both spectral and spatial domain via a single short exposure. In this setting one cannot trade time for spectral resolution, such as via spectral bands scanning. Cameras of color filter arrays (CFA) (e.g., the Bayer mosaic) cannot obtain high spectral resolution. To overcome these difficulties, we propose a new multispectral imaging system that makes random linear broadband measurements of the spectrum via a nanostructured multispectral filter array (MSFA). These MSFA random measurements can be used by sparsity-based recovery algorithms to achieve much higher spectral resolution than conventional CFA cameras, without sacrificing spatial resolution. The key innovation is to jointly exploit both spatial and spectral sparsity properties that are inherent to spectral irradiance of natural objects. Experimental results establish the superior performance of the proposed multispectral imaging system over existing ones.

Dual-Channel Reconstruction Network for Image Compressive Sensing.

The existing compressive sensing (CS) reconstruction algorithms require enormous computation and reconstruction quality that is not satisfying. In this paper, we propose a novel Dual-Channel Reconstruction Network (DC-Net) module to build two CS reconstruction networks: the first one recovers an image from its traditional random under-sampling measurements (RDC-Net); the second one recovers an image from its CS measurements acquired by a fully connected measurement matrix (FDC-Net). Especially, the fully connected under-sampling method makes CS measurements represent original images more effectively. For the two proposed networks, we use a fully connected layer to recover a preliminary reconstructed image, which is a linear mapping from CS measurements to the preliminary reconstructed image. The DC-Net module is used to further improve the preliminary reconstructed image quality. In the DC-Net module, a residual block channel can improve reconstruction quality and dense block channel can expedite calculation, whose fusion can improve the reconstruction performance and reduce runtime simultaneously. Extensive experiments manifest that the two proposed networks outperform state-of-the-art CS reconstruction methods in PSNR and have excellent visual reconstruction effects.

Dual-camera design for coded aperture snapshot spectral imaging.

Coded aperture snapshot spectral imaging (CASSI) provides an efficient mechanism for recovering 3D spectral data from a single 2D measurement. However, since the reconstruction problem is severely underdetermined, the quality of recovered spectral data is usually limited. In this paper we propose a novel dual-camera design to improve the performance of CASSI while maintaining its snapshot advantage. Specifically, a beam splitter is placed in front of the objective lens of CASSI, which allows the same scene to be simultaneously captured by a grayscale camera. This uncoded grayscale measurement, in conjunction with the coded CASSI measurement, greatly eases the reconstruction problem and yields high-quality 3D spectral data. Both simulation and experimental results demonstrate the effectiveness of the proposed method.

Compressive spectral imaging using variable number of measurements.

The compressive spectral imaging method always cuts down on the number of images for obtaining the spectral data cube of a scene. Our method cuts down on the number of sensors on the imaging plane, so as to fit some practical constraints, (e.g., size, weight, battery capacity, memory space, transmission bandwidth). Moreover, only a few of sensors on the imaging plane are needed, while more prior knowledge about the object in the scene has been achieved. The proposed method is based on the concept of coded dispersion, by which many pixels of spectral data are caught by one pixel on the imaging plane. Its measurement matrix is modified so that the number of measurements can be variable under different circumstances to save the transmission bandwidth. We demonstrate the validity of the proposed method, that with prior knowledge of scenes available, it offers a way to acquire spectral images using a variable number of measurements.

A new optical surface measurement method with iterative sparsity-constrained threshold phase retrieval algorithm.

Due to its low complexity and acceptable accuracy, phase retrieval technique has been proposed as an alternative to solve the classic optical surface measurement task. However, to capture the overall wave field, phase retrieval based optical surface measurement (PROSM) system has to moderate the CCD position during the multiple-sampling procedure. The mechanical modules of CCD movement may bring about unexpectable deviation to the final results. To overcome this drawback, we propose a new PROSM method based on spatial light modulator (SLM). The mechanical CCD movement can be replaced by an electrical moderation of SLM patterns; thus the deviation can be significantly suppressed in the new PROSM method. In addition, to further improve the performance, we propose a new iterative threshold phase retrieval algorithm with sparsity-constraint to effectively reconstruct the phase of wave field. Experimental results show that the new method provides a more simple and robust solution for the optical surface measurement than the traditional techniques and achieves higher accuracy.

Superimposed Semantic Communication for IoT-Based Real-Time ECG Monitoring.

Real-time electrocardiogram (ECG) monitoring and diagnosis through Internet of Things (IoT) are crucial for addressing the severity and timely treatment of cardiovascular diseases, enabling timely intervention and preventing life-threatening complications. However, current ECG monitoring research predominantly focuses on individual aspects such as signal compression, diagnostic analysis, or secure transmission, lacking joint optimization of various modules in IoT scenarios. To address this gap, this work proposes a novel framework based on superimposed semantic communication for real-time ECG monitoring in IoT. The framework comprises three hierarchical levels: the edge level for data collection and processing, the relay level for signal compression and coding, and the cloud level for data analysis and reconstruction. The proposed framework offers several unique advantages. By employing semantic encoding guided by ECG classification tasks, it selectively extracts crucial features within and between signals, improving compression ratio and adaptability to channel noise. The superimposed semantic encoding achieves content encryption without requiring any additional operations. Moreover, the framework utilizes lightweight anomaly detection neural networks, reducing edge device power consumption and conserving communication resources. Simulation and real experimental results demonstrate that the proposed method achieves real-time encoding and transmission of ECG signals with a compression ratio of 0.019 on the MIT-BIH dataset. Furthermore, it attains a heartbeat classification accuracy of 0.988 and a reconstruction error of 0.061.

High-resolution spectral imaging based on coded dispersion.

Since the energy of the incident light is constant, the spatial and spectral resolution can hardly be improved without scarifying the other with the spectral imaging method of a pushbroom scanner. Thus, a new spectral imaging method is proposed to obtain a high-resolution (HR) spectral image with a low-resolution detector array. The method, namely coded dispersion, by which compressive measurement is achieved, improves light collection efficiency, and then a high-quality reconstructed HR spectral image is obtained with fewer sensors. The simulation result shows that with prior knowledge of scenes available, the proposed method also offers a new way to acquire an HR spectral image while the density of detector array is constrained by battery, capacity, transmission bandwidth, and cost.

Multispectral Image Restoration via Inter- and Intra-block Sparse Estimation based on Physically-induced Joint Spatiospectral Structures.

Existing low-level vision algorithms (e.g., those for superresolution, denoising, deblurring etc.) were primarily motivated and optimized for precision in spatial domain. However, high precision in spectral domain is of importance for many applications in scientific and technical fields, such as spectral analysis, recognition, and classification. In quest for both high spectral and spatial fidelity we introduce previously-unexplored, physically-induced, joint spatiospectral sparsities to improve existing methods for multispectral image restoration. The bidirectional image formation model is used to reveal that the discontinuities of a multispectral image tend to align spatially across different spectral bands; in other words, the 2D Laplacians of different bands are not only sparse each, but they also agree with one the other in significance positions. Such strongly structured sparsities give rise to a new inter-and intra-block sparse estimation approach. The estimation is performed on 3D spatiospectral sample blocks, rather than on separate 2D patches, one per spectral band or per luminance and chrominance component as in current practice. Moreover, intra-block and inter-block sparsity priors are combined via an intra-block ℓ1,2-norm minimization term and an inter-block low rank term, strengthening the regularization of the underlying inverse problem. The new approach is tested and evaluated on two concrete applications: superresolving and denoising multispectral images; its validity and advantages over the current state of the art are established by empirical results.

High-resolution imaging via moving random exposure and its simulation.

In this correspondence, we introduce a new imaging method to obtain high-resolution (HR) images. The image acquisition is performed in two stages, compressive measurement and optimization reconstruction. In order to reconstruct HR images by a small number of sensors, compressive measurements are made. Specifically, compressive measurements are made by a low-resolution (LR) camera with randomly fluttering shutter, which can be viewed as a moving random exposure pattern. In the optimization reconstruction stage, the HR image is computed by different models according to the prior knowledge of scenes. The proposed imaging method offers a new way of acquiring HR images of essentially static scenes when the camera resolution is limited by severe constraints such as cost, battery capacity, memory space, transmission bandwidth, etc. and when the prior knowledge of scenes is available. The simulation results demonstrate the effectiveness of the proposed imaging method.