DiffSemanticFusion: Semantic Raster BEV Fusion for Autonomous Driving via Online HD Map Diffusion
Zhigang Sun, Yiru Wang, Anqing Jiang, Shuo Wang, Yu Gao, Yuwen Heng, Shouyi Zhang, An He, Hao Jiang, Jinhao Chai, Zichong Gu, Wang Jijun, Shichen Tang, Lavdim Halilaj, Juergen Luettin, Hao Sun
2025-08-07
Summary
This paper talks about DiffSemanticFusion, a new system that improves how self-driving cars understand their surroundings by combining different types of map information into one clear picture. It uses a special map diffusion process to make the maps more stable and accurate during driving.
What's the problem?
The problem is that self-driving cars need very detailed and reliable maps to navigate safely, but existing map types either provide unclear shapes or lose important road details when the map is created on the fly, making it hard for the car to plan routes and predict movements correctly.
What's the solution?
The solution was to create a fusion system that combines the strengths of raster-based maps, which work well with camera vision, and graph-based maps, which keep detailed structures, enhanced by a map diffusion module that fixes noise and missing data. This combination improves how the car predicts other vehicles' paths and plans its own route end-to-end.
Why it matters?
This matters because making autonomous vehicles better at understanding their environment leads to safer and more reliable self-driving cars. By improving map quality and prediction, DiffSemanticFusion helps reduce accidents and makes autonomous driving more practical for everyday use.
Abstract
DiffSemanticFusion enhances autonomous driving by fusing semantic raster and graph-based representations using a map diffusion module, improving trajectory prediction and end-to-end driving performance.