VAGAN: Vehicle-Aware Generative Adversarial Networks for Vehicle Detection in Rain

Page view(s)
45
Checked on Apr 08, 2024
VAGAN: Vehicle-Aware Generative Adversarial Networks for Vehicle Detection in Rain
Title:
VAGAN: Vehicle-Aware Generative Adversarial Networks for Vehicle Detection in Rain
Journal Title:
The 16th International Conference on Control, Automation, Robotics and Vision (ICARCV2020)
Publication URL:
Publication Date:
13 December 2020
Citation:
Abstract:
Vision-based vehicle detection under bad weather conditions is still a challenging problem. Adhesive raindrops on windshield have been known to diffract light and distort parts of the scene behind them. In this paper, we propose a Vehicle-Aware Generative Adversarial Networks (VAGAN) to improve vehicle detection from rain images. We train a Generative Adversarial Network (GAN) on image pairs, each comprising of an original rain image and one that is manually labelled with colored bounding boxes of the vehicles therein. The latter represents a fake version of the original image emphasizing the regions of interest. To further enhance vehicle awareness, we exploit the fact that the vehicle rear lights are usually turned on during rainy conditions to compute a saliency map of image, and use it formulate a background preserving constrain on the learning vehicle loss function. We show that this novel adversarial framework is able to generate new images with colored regions overlay over vehicles, hence effectively learning to differentiate image background from vehicles. The final vehicle detection in the generated images is not affected by image translation noise because we can simply use color segmentation to localize the vehicles. Experimental results on a large dataset show that our approach is an effective way to solve vehicle detection in rain images, achieving state-of-the-art performance.
License type:
Funding Info:
This research is supported by the Agency for Science, Technology and Research (A*STAR) under its <GAP(ETPL/18-GAP055-R20A)>
Description:
Article is open access
ISBN:

Files uploaded: