Capraru, R., Wang, J., Soong, B.H. psampling Data Challenge: Object-aware Approach for 3D Object Detection in Rain. Advanced Concepts for Intelligent Vision Systems (Acivs 2023)
Abstract:
Lidar-based 3D object detection has been widely adopted for autonomous vehicles. However, adverse weather conditions, such as rain, pose significant challenges by reducing both detection distance and accuracy. Intuitively, one could adopt upsampling to improve detection accuracy. Nevertheless, the task of increasing the number of target points, especially the key detection points crucial for object detection, remains an open issue. In this paper, we explore how an additional data upsampling pre-processing stage to increase the density of the point cloud can potentially benefit deep-learning object detection. Unlike the state-ofthe-art upsampling approaches which aim to improve point cloud appearance and uniformity, we are interested in optimizing the object detection task. The object of interest, rather than full scenarios or small
patches, is used to train the network - we call it object-aware learning. Additionally, data collection and labelling are time-consuming and expensive, especially for rain scenarios. To tackle this challenge, we propose a semi-supervised upsampling network that can be trained using a relatively small number of labelled simulated objects. Lastly, we verify a well-established sensor/rain simulator further, using a publicly available database. The experimental results on a database generated by this simulator are promising and have shown that our object-aware networks can extend the detection range in rainy scenarios by several meters and can achieve improvements in Bird-eye-View Intersection-over-Union (BEV IoU) detection accuracy.
License type:
Publisher Copyright
Funding Info:
This research / project is supported by the Singapore government’s Research - Innovation and Enterprise 2020 plan (Advanced Manufacturing and Engineering domain)
Grant Reference no. : I2001E0063