Your browser doesn't support javascript.
loading
Real-World Spatial Synchronization of Event-CMOS Cameras through Deep Learning: A Novel CNN-DGCNN Approach.
Mizrahi, Dor; Laufer, Ilan; Zuckerman, Inon.
Affiliation
  • Mizrahi D; Department of Industrial Engineering and Management, Ariel University, Ariel 40700, Israel.
  • Laufer I; Applied Physics Division, Soreq NRC, Yavne 81800, Israel.
  • Zuckerman I; Department of Industrial Engineering and Management, Ariel University, Ariel 40700, Israel.
Sensors (Basel) ; 24(13)2024 Jun 21.
Article in En | MEDLINE | ID: mdl-39000829
ABSTRACT
This paper presents a new deep-learning architecture designed to enhance the spatial synchronization between CMOS and event cameras by harnessing their complementary characteristics. While CMOS cameras produce high-quality imagery, they struggle in rapidly changing environments-a limitation that event cameras overcome due to their superior temporal resolution and motion clarity. However, effective integration of these two technologies relies on achieving precise spatial alignment, a challenge unaddressed by current algorithms. Our architecture leverages a dynamic graph convolutional neural network (DGCNN) to process event data directly, improving synchronization accuracy. We found that synchronization precision strongly correlates with the spatial concentration and density of events, with denser distributions yielding better alignment results. Our empirical results demonstrate that areas with denser event clusters enhance calibration accuracy, with calibration errors increasing in more uniformly distributed event scenarios. This research pioneers scene-based synchronization between CMOS and event cameras, paving the way for advancements in mixed-modality visual systems. The implications are significant for applications requiring detailed visual and temporal information, setting new directions for the future of visual perception technologies.
Key words

Full text: 1 Collection: 01-internacional Database: MEDLINE Language: En Journal: Sensors (Basel) Year: 2024 Document type: Article Affiliation country: Israel

Full text: 1 Collection: 01-internacional Database: MEDLINE Language: En Journal: Sensors (Basel) Year: 2024 Document type: Article Affiliation country: Israel