Fusion techniques of frame and event cameras in autonomous driving: A review
Document Type
Article
Publication Date
3-1-2026
Abstract
The rapid advancement of autonomous driving technology demands robust environmental perception systems capable of operating under extreme illumination variations, high-speed motion, and adverse weather conditions. While conventional frame-based cameras offer rich spatial and textural information, they suffer from fixed frame rates and limited dynamic range. Event cameras, as neuromorphic vision sensors, provide unique advantages in temporal resolution, dynamic range, and power efficiency through asynchronous pixel-level brightness change detection. This paper presents the first comprehensive review of frame-event camera fusion technology for autonomous driving applications. This paper establishes a fusion framework tailored to autonomous driving perception requirements and analyzes the complementary characteristics of both sensor modalities in addressing critical perception challenges. This paper proposes the first systematic classification of frame-event fusion architectures, covering multi-level approaches from data-level to decision-level integration, while tracing the technical evolution of fusion strategies. Additionally, this paper constructs a dataset evaluation framework for autonomous driving tasks, providing systematic benchmark selection guidance. Through detailed analysis of deployment challenges, this paper identifies key technical barriers including temporal synchronization, computational efficiency, and cross-modal calibration, alongside corresponding solutions. Finally, this paper presents perspectives on emerging paradigms and future directions, providing essential references for advancing practical frame-event fusion applications in autonomous driving.
Keywords
Autonomous driving, Computer vision, Event cameras, Multimodal sensing, Neuromorphic vision, Sensor fusion
Publication Title
Information Fusion
ISSN
1566-2535
DOI
10.1016/j.inffus.2025.103697
Recommended Citation
Shi, Peijun; Chow, Chee Onn; and Wong, Wei Ru, "Fusion techniques of frame and event cameras in autonomous driving: A review" (2026). Research Publications (2026 to 2030). 1044.
https://knova.um.edu.my/research_publications_2026_2030/1044
Volume
127
Publisher
Elsevier B.V.