Deep camera obscura: an image restoration pipeline for pinhole photography.

Modern machine learning has enhanced the image quality for consumer and mobile photography through low-light denoising, high dynamic range (HDR) imaging, and improved demosaicing among other applications. While most of these advances have been made for normal lens-based cameras, there has been an emerging body of research for improved photography for lensless cameras using thin optics such as amplitude or phase masks, diffraction gratings, or diffusion layers. These lensless cameras are suited for size and cost-constrained applications such as tiny robotics and microscopy that prohibit the use of a large lens. However, the earliest and simplest camera design, the camera obscura or pinhole camera, has been relatively overlooked for machine learning pipelines with minimal research on enhancing pinhole camera images for everyday photography applications. In this paper, we develop an image restoration pipeline of the pinhole system to enhance the pinhole image quality through joint denoising and deblurring. Our pipeline integrates optics-based filtering and reblur losses for reconstructing high resolution still images (2600 × 1952) as well as temporal consistency for video reconstruction to enable practical exposure times (30 FPS) for high resolution video (1920 × 1080). We demonstrate high 2D image quality on real pinhole images that is on-par or slightly improved compared to other lensless cameras. This work opens up the potential of pinhole cameras to be used for photography in size-limited devices such as smartphones in the future.

CS-ToF: High-resolution compressive time-of-flight imaging.

Three-dimensional imaging using Time-of-flight (ToF) sensors is rapidly gaining widespread adoption in many applications due to their cost effectiveness, simplicity, and compact size. However, the current generation of ToF cameras suffers from low spatial resolution due to physical fabrication limitations. In this paper, we propose CS-ToF, an imaging architecture to achieve high spatial resolution ToF imaging via optical multiplexing and compressive sensing. Our approach is based on the observation that, while depth is non-linearly related to ToF pixel measurements, a phasor representation of captured images results in a linear image formation model. We utilize this property to develop a CS-based technique that is used to recover high resolution 3D images. Based on the proposed architecture, we developed a prototype 1-megapixel compressive ToF camera that achieves as much as 4× improvement in spatial resolution and 3× improvement for natural scenes. We believe that our proposed CS-ToF architecture provides a simple and low-cost solution to improve the spatial resolution of ToF and related sensors.

Compressive holographic video.

Compressed sensing has been discussed separately in spatial and temporal domains. Compressive holography has been introduced as a method that allows 3D tomographic reconstruction at different depths from a single 2D image. Coded exposure is a temporal compressed sensing method for high speed video acquisition. In this work, we combine compressive holography and coded exposure techniques and extend the discussion to 4D reconstruction in space and time from one coded captured image. In our prototype, digital in-line holography was used for imaging macroscopic, fast moving objects. The pixel-wise temporal modulation was implemented by a digital micromirror device. In this paper we demonstrate 10× temporal super resolution with multiple depths recovery from a single image. Two examples are presented for the purpose of recording subtle vibrations and tracking small particles within 5 ms.

Mechanical Fault Diagnosis of High Voltage Circuit Breakers Based on Variational Mode Decomposition and Multi-Layer Classifier.

Mechanical fault diagnosis of high-voltage circuit breakers (HVCBs) based on vibration signal analysis is one of the most significant issues in improving the reliability and reducing the outage cost for power systems. The limitation of training samples and types of machine faults in HVCBs causes the existing mechanical fault diagnostic methods to recognize new types of machine faults easily without training samples as either a normal condition or a wrong fault type. A new mechanical fault diagnosis method for HVCBs based on variational mode decomposition (VMD) and multi-layer classifier (MLC) is proposed to improve the accuracy of fault diagnosis. First, HVCB vibration signals during operation are measured using an acceleration sensor. Second, a VMD algorithm is used to decompose the vibration signals into several intrinsic mode functions (IMFs). The IMF matrix is divided into submatrices to compute the local singular values (LSV). The maximum singular values of each submatrix are selected as the feature vectors for fault diagnosis. Finally, a MLC composed of two one-class support vector machines (OCSVMs) and a support vector machine (SVM) is constructed to identify the fault type. Two layers of independent OCSVM are adopted to distinguish normal or fault conditions with known or unknown fault types, respectively. On this basis, SVM recognizes the specific fault type. Real diagnostic experiments are conducted with a real SF6 HVCB with normal and fault states. Three different faults (i.e., jam fault of the iron core, looseness of the base screw, and poor lubrication of the connecting lever) are simulated in a field experiment on a real HVCB to test the feasibility of the proposed method. Results show that the classification accuracy of the new method is superior to other traditional methods.

Intentions of healthcare seeking and self-isolation for MPOX among men who have sex with men in China: a national cross-sectional study.

Linking identified MPOX cases to care is essential for MPOX control. This study aims to investigate the intentions of healthcare seeking and self-isolation for MPOX among men who have sex with men (MSM) in China. A cross-sectional online survey was conducted in early August 2023 in China. Respondents were recruited by community-based organizations (CBOs), collecting information on demographics, health status, behavioural and psychological characteristics. Univariate and multivariate logistic regression analyses were performed to examine the predictors of intentions to seek healthcare and self-isolate for MPOX within the MSM population. A total of 7725 participants were recruited, with a median age of 30 years. 92.21% of the participants would seek healthcare for MPOX-like symptoms, but only 52.50% intended to self-isolate if diagnosed. Intentions to seek healthcare were lower among those with MPOX-like symptoms in the past 3 months (standardized prevalence ratio (SPRs) = 0.82, 95% CI: 0.74-0.89) and the willingness to self-isolate was reduced among those diagnosed with MPOX in the past 3 months (SPRs = 0.65, 95% CI: 0.48-0.87). Participants free of sexually transmitted infections (STIs) and those aware of their HIV status were more likely to seek healthcare and self-isolate than those with STIs or unaware of their HIV status. Regular followers of MPOX information and those perceiving a low risk of infection were more inclined to take preventive measures. These findings highlight the need for targeted MPOX prevention strategies for high-risk groups and the importance of addressing barriers in infectious disease prevention response.

JPD-SE: High-Level Semantics for Joint Perception-Distortion Enhancement in Image Compression.

While humans can effortlessly transform complex visual scenes into simple words and the other way around by leveraging their high-level understanding of the content, conventional or the more recent learned image compression codecs do not seem to utilize the semantic meanings of visual content to their full potential. Moreover, they focus mostly on rate-distortion and tend to underperform in perception quality especially in low bitrate regime, and often disregard the performance of downstream computer vision algorithms, which is a fast-growing consumer group of compressed images in addition to human viewers. In this paper, we (1) present a generic framework that can enable any image codec to leverage high-level semantics and (2) study the joint optimization of perception quality and distortion. Our idea is that given any codec, we utilize high-level semantics to augment the low-level visual features extracted by it and produce essentially a new, semantic-aware codec. We propose a three-phase training scheme that teaches semantic-aware codecs to leverage the power of semantic to jointly optimize rate-perception-distortion (R-PD) performance. As an additional benefit, semantic-aware codecs also boost the performance of downstream computer vision algorithms. To validate our claim, we perform extensive empirical evaluations and provide both quantitative and qualitative results.

Development of a Wearable Electrical Impedance Tomographic Sensor for Gesture Recognition With Machine Learning.

A wearable electrical impedance tomographic (wEIT) sensor with 8 electrodes is developed to realize gesture recognition with machine learning algorithms. To optimize the wEIT sensor, gesture recognition rates are compared by using a series of electrodes with different materials and shapes. To improve the gesture recognition rates, several Machine Learning algorithms are used to recognize three different gestures with the obtained voltage data. To clarify the gesture recognition mechanism, an electrical model of the electrode-skin contact impedance is established. Experimental results show that: rectangular copper electrodes realize the highest recognition rate; the existence of the electrode-skin contact impedance could improve the gesture recognition rate; Medium Gaussian SVM (Support Vector Machine) algorithm is the optimal algorithm with an average recognition rate of 95%.