Asif, M., Lim, H. W., Thadimari, Y., Imanberdiyev, N., & Camci, E. (2024). Localization of a Tethered Drone & Ground Robot Team by Deep Neural Networks. 2024 IEEE 27th International Conference on Intelligent Transportation Systems (ITSC), 806–811. https://doi.org/10.1109/itsc58415.2024.10920023
Abstract:
Accurate localization of vehicles is vital for proper coordination in multi-vehicle missions. Drawing inspiration from the recent success in pose estimation of household objects using deep neural networks (DNNs), we propose a new approach for the localization of a tethered drone & ground robot team based on DNNs. Unlike most of the literature, we focus on the localization of such robots without any external infrastructure, such as the Global Navigation Satellite System (GNSS). This enables our robots to operate anywhere, such as indoors where GNSS signals are not available, or in urban environments where the signals are downgraded due to high-rise buildings. Equipped with a downward-facing camera, our drone detects the ground robot in aerial images and estimates its relative pose on-the-fly using DNNs. This pose is then fused with the simultaneous localization and mapping (SLAM) of the ground robot for tandem navigation of both vehicles. We create a digital twin of our robots in high-fidelity Gazebo simulations and collect custom datasets for DNN training. We then validate the trained DNNs through flight tests at various heights ranging from 5m to 15m. We extensively benchmark our approach through batched tests with two other infrastructure agnostic localization methods, AprilTag and OV2SLAM. While the purely AprilTag-based approach fails to go beyond 5m height and OV2SLAM requires rich visual features in the surroundings, our proposed approach can achieve flights at more than 10m height without depending on any external visual feature requirements. Finally, we conduct real robot tests demonstrating the real-time feasibility of our approach on an edge device (Nvidia Jetson AGX Orin).
License type:
Publisher Copyright
Funding Info:
This research / project is supported by the National Research Foundation - Cities of Tomorrow R&D Programme
Grant Reference no. : CoT-V1-2023-2
This research / project is supported by the Agency for Science, Technology and Research - Robotics - Horizontal Technology Coordinating Offices
Grant Reference no. : C221518005
This research / project is supported by the Agency for Science, Technology and Research - N.A.
Grant Reference no. : M21K1a0104