Time division multiplexing based multi-spectral semantic camera for LiDAR applications.

The recent progress in the development of measurement systems for autonomous recognition had a substantial impact on emerging technology in numerous fields, especially robotics and automotive applications. In particular, time-of-flight (TOF) based light detection and ranging (LiDAR) systems enable to map the surrounding environmental information over long distances and with high accuracy. The combination of advanced LiDAR with an artificial intelligence platform allows enhanced object recognition and classification, which however still suffers from limitations of inaccuracy and misidentification. Recently, multi-spectral LiDAR systems have been employed to increase the object recognition performance by additionally providing material information in the short-wave infrared (SWIR) range where the reflection spectrum characteristics are typically very sensitive to material properties. However, previous multi-spectral LiDAR systems utilized band-pass filters or complex dispersive optical systems and even required multiple photodetectors, adding complexity and cost. In this work, we propose a time-division-multiplexing (TDM) based multi-spectral LiDAR system for semantic object inference by the simultaneous acquisition of spatial and spectral information. By utilizing the TDM method, we enable the simultaneous acquisition of spatial and spectral information as well as a TOF based distance map with minimized optical loss using only a single photodetector. Our LiDAR system utilizes nanosecond pulses of five different wavelengths in the SWIR range to acquire sufficient material information in addition to 3D spatial information. To demonstrate the recognition performance, we map the multi-spectral image from a human hand, a mannequin hand, a fabric gloved hand, a nitrile gloved hand, and a printed human hand onto an RGB-color encoded image, which clearly visualizes spectral differences as RGB color depending on the material while having a similar shape. Additionally, the classification performance of the multi-spectral image is demonstrated with a convolution neural network (CNN) model using the full multi-spectral data set. Our work presents a compact novel spectroscopic LiDAR system, which provides increased recognition performance and thus a great potential to improve safety and reliability in autonomous driving.

Multichannel Hierarchical Analysis of Time-Resolved Hyperspectral Data for Advanced Colorimetric E-Nose.

The colorimetric sensor-based electronic nose has been demonstrated to discriminate specific gaseous molecules for various applications, including health or environmental monitoring. However, conventional colorimetric sensor systems rely on RGB sensors, which cannot capture the complete spectral response of the system. This limitation can degrade the performance of machine learning analysis, leading to inaccurate identification of chemicals with similar functional groups. Here, we propose a novel time-resolved hyperspectral (TRH) data set from colorimetric array sensors consisting of 1D spatial, 1D spectral, and 1D temporal axes, which enables hierarchical analysis of multichannel 2D spectrograms via a convolution neural network (CNN). We assessed the outstanding classification performance of the TRH data set compared to an RGB data set by conducting a relative humidity (RH) concentration classification. The time-dependent spectral response of the colorimetric sensor was measured and trained as a CNN model using TRH and RGB sensor systems at different RH levels. While the TRH model shows a high classification accuracy of 97.5% for the RH concentration, the RGB model yields 72.5% under identical conditions. Furthermore, we demonstrated the detection of various functional volatile gases with the TRH system by using experimental and simulation approaches. The results reveal distinct spectral features from the TRH system, corresponding to changes in the concentration of each substance.

Gain enhancement of perovskite nanosheets by a patterned waveguide: excitation and temperature dependence of gain saturation.

Optical gain enhancement of two-dimensional CsPbBr3 nanosheets was studied when the amplified spontaneous emission is guided by a patterned structure of polyurethane-acrylate. Given the uncertainties and pitfalls in retrieving a gain coefficient from the variable stripe length method, a gain contour [Formula: see text] was obtained in the plane of spectrum energy (ℏω) and stripe length (x), whereby an average gain was obtained, and gain saturation was analysed. Excitation and temperature dependence of the gain contour show that the waveguide enhances both gain and thermal stability due to the increased optical confinement and heat dissipation, and the gain origins were attributed to the two-dimensional excitons and the localized states.