A Vehicle-Edge-Cloud Framework for Computational Analysis of a Fine-Tuned Deep Learning Model.

The cooperative, connected, and automated mobility (CCAM) infrastructure plays a key role in understanding and enhancing the environmental perception of autonomous vehicles (AVs) driving in complex urban settings. However, the deployment of CCAM infrastructure necessitates the efficient selection of the computational processing layer and deployment of machine learning (ML) and deep learning (DL) models to achieve greater performance of AVs in complex urban environments. In this paper, we propose a computational framework and analyze the effectiveness of a custom-trained DL model (YOLOv8) when deployed in diverse devices and settings at the vehicle-edge-cloud-layered architecture. Our main focus is to understand the interplay and relationship between the DL model's accuracy and execution time during deployment at the layered framework. Therefore, we investigate the trade-offs between accuracy and time by the deployment process of the YOLOv8 model over each layer of the computational framework. We consider the CCAM infrastructures, i.e., sensory devices, computation, and communication at each layer. The findings reveal that the performance metrics results (e.g., 0.842 mAP@0.5) of deployed DL models remain consistent regardless of the device type across any layer of the framework. However, we observe that inference times for object detection tasks tend to decrease when the DL model is subjected to different environmental conditions. For instance, the Jetson AGX (non-GPU) outperforms the Raspberry Pi (non-GPU) by reducing inference time by 72%, whereas the Jetson AGX Xavier (GPU) outperforms the Jetson AGX ARMv8 (non-GPU) by reducing inference time by 90%. A complete average time comparison analysis for the transfer time, preprocess time, and total time of devices Apple M2 Max, Intel Xeon, Tesla T4, NVIDIA A100, Tesla V100, etc., is provided in the paper. Our findings direct the researchers and practitioners to select the most appropriate device type and environment for the deployment of DL models required for production.

Optical detection of terahertz using nonlinear parametric upconversion.

We extend our work to perform sensitive, room-temperature optical detection of terahertz (THz) by using nonlinear parametric upconversion. THz radiation at 700 GHz is mixed with pump light at 1,550 nm in a bulk GaAs crystal to generate an idler wave at 1,555.6 nm. The idler is separated, coupled into optical fiber, and detected using a gated Geiger-mode avalanche photodiode. The resulting THz detector has a power sensitivity of 4.5 pW/Hz and a timing resolution of 1 ns.

Optical detection of terahertz radiation by using nonlinear parametric upconversion.

We describe and demonstrate sensitive room-temperature detection of terahertz (THz) radiation by nonlinearly upconverting terahertz to the near-infrared regime, relying on telecommications components. THz radiation at 700 GHz is mixed with pump light at 1550 nm in a bulk GaAs crystal to generate an idler wave at 1555.6 nm, which is separated and detected by using a commercial p-i-n diode. The THz detector operates at room temperature and has an intrinsic THz-to-optical photon conversion efficiency of 0.001%.