Polony gels enable amplifiable DNA stamping and spatial transcriptomics of chronic pain.

Methods for acquiring spatially resolved omics data from complex tissues use barcoded DNA arrays of low- to sub-micrometer features to achieve single-cell resolution. However, fabricating such arrays (randomly assembled beads, DNA nanoballs, or clusters) requires sequencing barcodes in each array, limiting cost-effectiveness and throughput. Here, we describe a vastly scalable stamping method to fabricate polony gels, arrays of ∼1-micrometer clonal DNA clusters bearing unique barcodes. By enabling repeatable enzymatic replication of barcode-patterned gels, this method, compared with the sequencing-dependent array fabrication, reduced cost by at least 35-fold and time to approximately 7 h. The gel stamping was implemented with a simple robotic arm and off-the-shelf reagents. We leveraged the resolution and RNA capture efficiency of polony gels to develop Pixel-seq, a single-cell spatial transcriptomic assay, and applied it to map the mouse parabrachial nucleus and analyze changes in neuropathic pain-regulated transcriptomes and cell-cell communication after nerve ligation.

Optical single-pixel volumetric imaging by three-dimensional light-field illumination.

Three-dimensional single-pixel imaging (3D SPI) has become an attractive imaging modality for both biomedical research and optical sensing. 3D-SPI techniques generally depend on time-of-flight or stereovision principle to extract depth information from backscattered light. However, existing implementations for these two optical schemes are limited to surface mapping of 3D objects at depth resolutions, at best, at the millimeter level. Here, we report 3D light-field illumination single-pixel microscopy (3D-LFI-SPM) that enables volumetric imaging of microscopic objects with a near-diffraction-limit 3D optical resolution. Aimed at 3D space reconstruction, 3D-LFI-SPM optically samples the 3D Fourier spectrum by combining 3D structured light-field illumination with single-element intensity detection. We build a 3D-LFI-SPM prototype that provides an imaging volume of ∼390 × 390 × 3,800 µm3 and achieves 2.7-µm lateral resolution and better than 37-µm axial resolution. Its capability of 3D visualization of label-free optical absorption contrast is demonstrated by imaging single algal cells in vivo. Our approach opens broad perspectives for 3D SPI with potential applications in various fields, such as biomedical functional imaging.

Characterizing electron-collecting CdTe for use in a 77†ns burst-rate imager.

The Keck-PAD (pixel array detector) was developed at Cornell as a burst-rate imager capable of recording images from successive electron bunches (153 ns period) from the Advanced Photon Source (APS). Both Si and hole-collecting Schottky CdTe have been successfully bonded to this ASIC (application-specific integrated circuit) and used with this frame rate. The facility upgrades at the APS will lower the bunch period to 77 ns, which will require modifications to the Keck-PAD electronics to image properly at this reduced period. In addition, operation at high X-ray energies will require a different sensor material having a shorter charge collection time. For the target energy of 40 keV for this project, simulations have shown that electron-collecting CdTe should allow >90% charge collection within 35 ns. This collection time will be sufficient to sample the signal from one frame and prepare for the next. 750 µm-thick electron-collecting Schottky CdTe has been obtained from Acrorad and bonded to two different charge-integrating ASICs developed at Cornell, the Keck-PAD and the CU-APS-PAD. Carrier mobility has been investigated using the detector response to single X-ray bunches at the Cornell High Energy Synchrotron Source and to a pulsed optical laser. The tests indicate that the collection time will meet the requirements for 77 ns imaging.

Uncovering the Nexus between Urban Heat Islands and Material Stocks of Built Environment in 335 Chinese Cities.

China's unprecedented rapid urbanization has dramatically reshaped the urban built environment, disrupting the thermal balance of cities. This disruption causes the urban heat island (UHI) effect, adversely affecting urban sustainability and public health. Although studies have highlighted the remarkable impacts of the built environment on UHIs, the specific effects of its various structures and components remain unclear. In this study, a multidimensional remote sensing data set was used to quantify the atmospheric UHIs across 335 Chinese cities from 1980 to 2020. In conjunction with stocks of three end-use sectors and three material groups, the impacts of gridded material stocks on UHI variations were analyzed. The findings reveal that building stocks exert a predominant influence in 48% of cities. Additionally, the extensive use of metal and inorganic materials has increased thermal stress in 220 cities, leading to an average UHI increase of 0.54 °C. The effect of organic materials, primarily arising from mobile heat sources, is continuously increasing. Overall, this study elucidates the effect of the functional structure and material composition of urban landscapes on UHIs, highlighting the complexities associated with the influence of the built environment on the urban heat load.

Automatic labeling of facial zones for digital clinical application: An ensemble of semantic segmentation models.

INTRODUCTION: The application of artificial intelligence to facial aesthetics has been limited by the inability to discern facial zones of interest, as defined by complex facial musculature and underlying structures. Although semantic segmentation models (SSMs) could potentially overcome this limitation, existing facial SSMs distinguish only three to nine facial zones of interest. METHODS: We developed a new supervised SSM, trained on 669 high-resolution clinical-grade facial images; a subset of these images was used in an iterative process between facial aesthetics experts and manual annotators that defined and labeled 33 facial zones of interest. RESULTS: Because some zones overlap, some pixels are included in multiple zones, violating the one-to-one relationship between a given pixel and a specific class (zone) required for SSMs. The full facial zone model was therefore used to create three sub-models, each with completely non-overlapping zones, generating three outputs for each input image that can be treated as standalone models. For each facial zone, the output demonstrating the best Intersection Over Union (IOU) value was selected as the winning prediction. CONCLUSIONS: The new SSM demonstrates mean IOU values superior to manual annotation and landmark analyses, and it is more robust than landmark methods in handling variances in facial shape and structure.

Preliminary Characterization of an Active CMOS Pad Detector for Tracking and Dosimetry in HDR Brachytherapy.

We assessed the accuracy of a prototype radiation detector with a built in CMOS amplifier for use in dosimetry for high dose rate brachytherapy. The detectors were fabricated on two substrates of epitaxial high resistivity silicon. The radiation detection performance of prototypes has been tested by ion beam induced charge (IBIC) microscopy using a 5.5 MeV alpha particle microbeam. We also carried out the HDR Ir-192 radiation source tracking at different depths and angular dose dependence in a water equivalent phantom. The detectors show sensitivities spanning from (5.8 ± 0.021) × 10-8 to (3.6 ± 0.14) × 10-8 nC Gy-1 mCi-1 mm-2. The depth variation of the dose is within 5% with that calculated by TG-43. Higher discrepancies are recorded for 2 mm and 7 mm depths due to the scattering of secondary particles and the perturbation of the radiation field induced in the ceramic/golden package. Dwell positions and dwell time are reconstructed within ±1 mm and 20 ms, respectively. The prototype detectors provide an unprecedented sensitivity thanks to its monolithic amplification stage. Future investigation of this technology will include the optimisation of the packaging technique.

Development of a Time Projection Chamber Readout with Hybrid Pixel Sensors for Beam Monitoring.

To monitor the position and profile of therapeutic carbon beams in real-time, in this paper, we proposed a system called HiBeam-T. The HiBeam-T is a time projection chamber (TPC) with forty Topmetal-II- CMOS pixel sensors as its readout. Each Topmetal-II- has 72 × 72 pixels with the size of 83 µm × 83 µm. The detector consists of the charge drift region and the charge collection area. The readout electronics comprise three Readout Control Modules and one Clock Synchronization Module. This Hibeam-T has a sensitive area of 20 × 20 cm and can acquire the center of the incident beams. The test with a continuous 80.55 MeV/u 12C6+ beam shows that the measurement resolution to the beam center could reach 6.45 µm for unsaturated beam projections.

Error Correction of the RapidEye Sub-Pixel Correlation: A Case Study of the 2019 Ridgecrest Earthquake Sequence.

The optical image sub-pixel correlation (SPC) technique is an important method for monitoring large-scale surface deformation. RapidEye images, distinguished by their short revisit period and high spatial resolution, are crucial data sources for monitoring surface deformation. However, few studies have comprehensively analyzed the error sources and correction methods of the deformation field obtained from RapidEye images. We used RapidEye images without surface deformation to analyze potential errors in the offset fields. We found that the errors in RapidEye offset fields primarily consist of decorrelation noise, orbit error, and attitude jitter distortions. To mitigate decorrelation noise, the careful selection of offset pairs coupled with spatial filtering is essential. Orbit error can be effectively mitigated by the polynomial fitting method. To address attitude jitter distortions, we introduced a linear fitting approach that incorporated the coherence of attitude jitter. To demonstrate the performance of the proposed methods, we utilized RapidEye images to extract the coseismic displacement field of the 2019 Ridgecrest earthquake sequence. The two-dimensional (2D) offset field contained deformation signals extracted from two earthquakes, with a maximum offset of 2.8 m in the E-W direction and 2.4 m in the N-S direction. A comparison with GNSS observations indicates that, after error correction, the mean relative precision of the offset field improved by 92% in the E-W direction and by 89% in the N-S direction. This robust enhancement underscores the effectiveness of the proposed error correction methods for RapidEye data. This study sheds light on large-scale surface deformation monitoring using RapidEye images.

Single-Pixel Imaging Based on Deep Learning Enhanced Singular Value Decomposition.

We propose and demonstrate a single-pixel imaging method based on deep learning network enhanced singular value decomposition. The theoretical framework and the experimental implementation are elaborated and compared with the conventional methods based on Hadamard patterns or deep convolutional autoencoder network. Simulation and experimental results show that the proposed approach is capable of reconstructing images with better quality especially under a low sampling ratio down to 3.12%, or with fewer measurements or shorter acquisition time if the image quality is given. We further demonstrate that it has better anti-noise performance by introducing noises in the SPI systems, and we show that it has better generalizability by applying the systems to targets outside the training dataset. We expect that the developed method will find potential applications based on single-pixel imaging beyond the visible regime.

Cost-Effective Optical Wireless Sensor Networks: Enhancing Detection of Sub-Pixel Transmitters in Camera-Based Communications.

In the domain of the Internet of Things (IoT), Optical Camera Communication (OCC) has garnered significant attention. This wireless technology employs solid-state lamps as transmitters and image sensors as receivers, offering a promising avenue for reducing energy costs and simplifying electronics. Moreover, image sensors are prevalent in various applications today, enabling dual functionality: recording and communication. However, a challenge arises when optical transmitters are not in close proximity to the camera, leading to sub-pixel projections on the image sensor and introducing strong channel dependence. Previous approaches, such as modifying camera optics or adjusting image sensor parameters, not only limited the camera's utility for purposes beyond communication but also made it challenging to accommodate multiple transmitters. In this paper, a novel sub-pixel optical transmitter discovery algorithm that overcomes these limitations is presented. This algorithm enables the use of OCC in scenarios with static transmitters and receivers without the need for camera modifications. This allows increasing the number of transmitters in a given scenario and alleviates the proximity and size limitations of the transmitters. Implemented in Python with multiprocessing programming schemes for efficiency, the algorithm achieved a 100% detection rate in nighttime scenarios, while there was a 89% detection rate indoors and a 72% rate outdoors during daylight. Detection rates were strongly influenced by varying transmitter types and lighting conditions. False positives remained minimal, and processing times were consistently under 1 s. With these results, the algorithm is considered suitable for export as a web service or as an intermediary component for data conversion into other network technologies.

An Efficient Attentional Image Dehazing Deep Network Using Two Color Space (ADMC2-net).

Image dehazing has become a crucial prerequisite for most outdoor computer applications. The majority of existing dehazing models can achieve the haze removal problem. However, they fail to preserve colors and fine details. Addressing this problem, we introduce a novel high-performing attention-based dehazing model (ADMC2-net)that successfully incorporates both RGB and HSV color spaces to maintain color properties. This model consists of two parallel densely connected sub-models (RGB and HSV) followed by a new efficient attention module. This attention module comprises pixel-attention and channel-attention mechanisms to get more haze-relevant features. Experimental results analyses can validate that our proposed model (ADMC2-net) can achieve superior results on synthetic and real-world datasets and outperform most of state-of-the-art methods.

Scalable High-Resolution Single-Pixel Imaging via Pattern Reshaping.

Single-pixel imaging (SPI) is an alternative method for obtaining images using a single photodetector, which has numerous advantages over the traditional matrix-based approach. However, most experimental SPI realizations provide relatively low resolution compared to matrix-based imaging systems. Here, we show a simple yet effective experimental method to scale up the resolution of SPI. Our imaging system utilizes patterns based on Hadamard matrices, which, when reshaped to a variable aspect ratio, allow us to improve resolution along one of the axes, while sweeping of patterns improves resolution along the second axis. This work paves the way towards novel imaging systems that retain the advantages of SPI and obtain resolution comparable to matrix-based systems.

YOLOv7-TS: A Traffic Sign Detection Model Based on Sub-Pixel Convolution and Feature Fusion.

In recent years, significant progress has been witnessed in the field of deep learning-based object detection. As a subtask in the field of object detection, traffic sign detection has great potential for development. However, the existing object detection methods for traffic sign detection in real-world scenes are plagued by issues such as the omission of small objects and low detection accuracies. To address these issues, a traffic sign detection model named YOLOv7-Traffic Sign (YOLOv7-TS) is proposed based on sub-pixel convolution and feature fusion. Firstly, the up-sampling capability of the sub-pixel convolution integrating channel dimension is harnessed and a Feature Map Extraction Module (FMEM) is devised to mitigate the channel information loss. Furthermore, a Multi-feature Interactive Fusion Network (MIFNet) is constructed to facilitate enhanced information interaction among all feature layers, improving the feature fusion effectiveness and strengthening the perception ability of small objects. Moreover, a Deep Feature Enhancement Module (DFEM) is established to accelerate the pooling process while enriching the highest-layer feature. YOLOv7-TS is evaluated on two traffic sign datasets, namely CCTSDB2021 and TT100K. Compared with YOLOv7, YOLOv7-TS, with a smaller number of parameters, achieves a significant enhancement of 3.63% and 2.68% in the mean Average Precision (mAP) for each respective dataset, proving the effectiveness of the proposed model.

Optical Encryption Using Attention-Inserted Physics-Driven Single-Pixel Imaging.

Optical encryption based on single-pixel imaging (SPI) has made great advances with the introduction of deep learning. However, the use of deep neural networks usually requires a long training time, and the networks need to be retrained once the target scene changes. With this in mind, we propose an SPI encryption scheme based on an attention-inserted physics-driven neural network. Here, an attention module is used to encrypt the single-pixel measurement value sequences of two images, together with a sequence of cryptographic keys, into a one-dimensional ciphertext signal to complete image encryption. Then, the encrypted signal is fed into a physics-driven neural network for high-fidelity decoding (i.e., decryption). This scheme eliminates the need for pre-training the network and gives more freedom to spatial modulation. Both simulation and experimental results have demonstrated the feasibility and eavesdropping resistance of this scheme. Thus, it will lead SPI-based optical encryption closer to intelligent deep encryption.

The Effect of Pixel Design and Operation Conditions on Linear Output Range of 4T CMOS Image Sensors.

We analyze several factors that affect the linear output range of CMOS image sensors, including charge transfer time, reset transistor supply voltage, the capacitance of integration capacitor, the n-well doping of the pinned photodiode (PPD) and the output buffer. The test chips are fabricated with 0.18 µm CMOS image sensor (CIS) process and comprise six channels. Channels B1 and B2 are 10 µm pixels and channels B3-B6 are 20 µm pixels, with corresponding pixel arrays of 1 × 2560 and 1 × 1280 respectively. The floating diffusion (FD) capacitance varies from 10 fF to 23.3 fF, and two different designs were employed for the n-well doping in PPD. The experimental results indicate that optimizing the FD capacitance and PPD design can enhance the linear output range by 37% and 32%, respectively. For larger pixel sizes, extending the transfer gate (TG) sampling time leads to an increase of over 60% in the linear output range. Furthermore, optimizing the design of the output buffer can alleviate restrictions on the linear output range. The lower reset voltage for noise reduction does not exhibit a significant impact on the linear output range. Furthermore, these methods can enhance the linear output range without significantly amplifying the readout noise. These findings indicate that the linear output range of pixels is not only influenced by pixel design but also by operational conditions. Finally, we conducted a detailed analysis of the impact of PPD n-well doping concentration and TG sampling time on the linear output range. This provides designers with a clear understanding of how nonlinearity is introduced into pixels, offering valuable insight in the design of highly linear pixels.

Improving Rebar Twist Prediction Exploiting Unified-Channel Attention-Based Image Restoration and Regression Techniques.

Recent research has made significant progress in automated unmanned systems utilizing Artificial Intelligence (AI)-based image processing to optimize the rebar manufacturing process and minimize defects such as twisting during production. Despite various studies, including those employing data augmentation through Generative Adversarial Networks (GANs), the performance of rebar twist prediction has been limited due to image quality degradation caused by environmental noise, such as insufficient image quality and inconsistent lighting conditions in rebar processing environments. To address these challenges, we propose a novel approach for real-time rebar twist prediction in manufacturing processes. Our method involves restoring low-quality grayscale images to high resolution and employing an object detection model to identify and track rebar endpoints. We then apply regression analysis to the coordinates obtained from the bounding boxes to estimate the error rate of the rebar endpoint positions, thereby determining the occurrence of twisting. To achieve this, we first developed a Unified-Channel Attention (UCA) module that is robust to changes in intensity and contrast for grayscale images. The UCA can be integrated into image restoration models to more accurately detect rebar endpoint characteristics in object detection models. Furthermore, we introduce a method for predicting the future positions of rebar endpoints using various linear and non-linear regression models. The predicted positions are used to calculate the error rate in rebar endpoint locations, determined by the distance between the actual and predicted positions, which is then used to classify the presence of rebar twisting. Our experimental results demonstrate that integrating the UCA module with our image restoration model significantly improved existing models in Peak Signal-to-Noise Ratio (PSNR) and Structural Similarity Index Measure (SSIM) metrics. Moreover, employing regression models to predict future rebar endpoint positions enhances the F1 score for twist prediction. As a result, our approach offers a practical solution for rapid defect detection in rebar manufacturing processes.

Investigating a Machine Learning Approach to Predicting White Pixel Defects in Wafers-A Case Study of Wafer Fabrication Plant F.

CMOS image sensor (CIS) semiconductor products are integral to mobile phones and photographic devices, necessitating ongoing enhancements in efficiency and quality for superior photographic outcomes. The presence of white pixels serves as a crucial metric for assessing CIS product performance, primarily arising from metal impurity contamination during the wafer production process or from defects introduced by the grinding blade process. While immediately addressing metal impurity contamination during production presents challenges, refining the handling of defects attributed to grinding blade processing can notably mitigate white pixel issues in CIS products. This study zeroes in on silicon wafer manufacturers in Taiwan, analyzing white pixel defects reported by customers and leveraging machine learning to pinpoint and predict key factors leading to white pixel defects from grinding blade operations. Such pioneering practical studies are rare. The findings reveal that the classification and regression tree (CART) and random forest (RF) models deliver the most accurate predictions (95.18%) of white pixel defects caused by grinding blade operations in a default parameter setting. The analysis further elucidates critical factors like grinding load and torque, vital for the genesis of white pixel defects. The insights garnered from this study aim to arm operators with proactive measures to diminish the potential for customer complaints.

Improving Measurement Accuracy of Deep Hole Measurement Instruments through Perspective Transformation.

Deep hole measurement is a crucial step in both deep hole machining and deep hole maintenance. Single-camera vision presents promising prospects in deep hole measurement due to its simple structure and low-cost advantages. However, the measurement error caused by the heating of the imaging sensor makes it difficult to achieve the ideal measurement accuracy. To compensate for measurement errors induced by imaging sensor heating, this study proposes an error compensation method for laser and vision-based deep hole measurement instruments. This method predicts the pixel displacement of the entire field of view using the pixel displacement of fixed targets within the camera's field of view and compensates for measurement errors through a perspective transformation. Theoretical analysis indicates that the perspective projection matrix changes due to the heating of the imaging sensor, which causes the thermally induced measurement error of the camera. By analyzing the displacement of the fixed target point, it is possible to monitor changes in the perspective projection matrix and thus compensate for camera measurement errors. In compensation experiments, using target displacement effectively predicts pixel drift in the pixel coordinate system. After compensation, the pixel error was suppressed from 1.99 pixels to 0.393 pixels. Repetitive measurement tests of the deep hole measurement instrument validate the practicality and reliability of compensating for thermal-induced errors using perspective transformation.

Pixel-Level Recognition of Trace Mycotoxins in Red Ginseng Based on Hyperspectral Imaging Combined with 1DCNN-Residual-BiLSTM-Attention Model.

Red ginseng is widely used in food and pharmaceuticals due to its significant nutritional value. However, during the processing and storage of red ginseng, it is susceptible to grow mold and produce mycotoxins, generating security issues. This study proposes a novel approach using hyperspectral imaging technology and a 1D-convolutional neural network-residual-bidirectional-long short-term memory attention mechanism (1DCNN-ResBiLSTM-Attention) for pixel-level mycotoxin recognition in red ginseng. The "Red Ginseng-Mycotoxin" (R-M) dataset is established, and optimal parameters for 1D-CNN, residual bidirectional long short-term memory (ResBiLSTM), and 1DCNN-ResBiLSTM-Attention models are determined. The models achieved testing accuracies of 98.75%, 99.03%, and 99.17%, respectively. To simulate real detection scenarios with potential interfering impurities during the sampling process, a "Red Ginseng-Mycotoxin-Interfering Impurities" (R-M-I) dataset was created. The testing accuracy of the 1DCNN-ResBiLSTM-Attention model reached 96.39%, and it successfully predicted pixel-wise classification for other unknown samples. This study introduces a novel method for real-time mycotoxin monitoring in traditional Chinese medicine, with important implications for the on-site quality control of herbal materials.

Accuracy Assessment of Geometric-Distortion Identification Methods for Sentinel-1 Synthetic Aperture Radar Imagery in Highland Mountainous Regions.

SAR imagery plays a crucial role in geological and environmental monitoring, particularly in highland mountainous regions. However, inherent geometric distortions in SAR images often undermine the precision of remote sensing analyses. Accurately identifying and classifying these distortions is key to analyzing their origins and enhancing the quality and accuracy of monitoring efforts. While the layover and shadow map (LSM) approach is commonly utilized to identify distortions, it falls short in classifying subtle ones. This study introduces a novel LSM ground-range slope (LG) method, tailored for the refined identification of minor distortions to augment the LSM approach. We implemented the LG method on Sentinel-1 SAR imagery from the tri-junction area where the Xiaojiang, Pudu, and Jinsha rivers converge at the Yunnan-Sichuan border. By comparing effective monitoring-point densities, we evaluated and validated traditional methods-LSM, R-Index, and P-NG-against the LG method. The LG method demonstrates superior performance in discriminating subtle distortions within complex terrains through its secondary classification process, which allows for precise and comprehensive recognition of geometric distortions. Furthermore, our research examines the impact of varying slope parameters during the classification process on the accuracy of distortion identification. This study addresses significant gaps in recognizing geometric distortions and lays a foundation for more precise SAR imagery analysis in complex geographic settings.