Cao, Z., Huang, Z., Pan, L., Zhang, S., Liu, Z., & Fu, C. (2022). TCTrack: Temporal Contexts for Aerial Tracking. 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 14778–14788. https://doi.org/10.1109/cvpr52688.2022.01438
Abstract:
Temporal contexts among consecutive frames are far from being fully utilized in existing visual trackers. In this work, we present TCTrack, a comprehensive framework to fully exploit temporal contexts for aerial tracking. The temporal contexts are incorporated at \textbf{two levels}: the extraction of \textbf{features} and the refinement of \textbf{similarity maps}. Specifically, for feature extraction, an online temporally adaptive convolution is proposed to enhance the spatial features using temporal information, which is achieved by dynamically calibrating the convolution weights according to the previous frames. For similarity map refinement, we propose an adaptive temporal transformer, which first effectively encodes temporal knowledge in a memory-efficient way, before the temporal knowledge is decoded for accurate adjustment of the similarity map. TCTrack is effective and efficient: evaluation on four aerial tracking benchmarks shows its impressive performance; real-world UAV tests show its high speed of over 27 FPS on NVIDIA Jetson AGX Xavier.
License type:
Publisher Copyright
Funding Info:
This research / project is supported by the Agency for Science, Technology and Research (A*STAR) - Advanced Manufacturing and Engineering (AME) Programmatic Grant
Grant Reference no. : A18A2b0046
This research / project is supported by the Agency for Science, Technology and Research (A*STAR) - RIE2020 Industry Alignment Fund – Industry Collaboration Projects (IAF-ICP) Funding Initiative
Grant Reference no. :
This research / project is supported by the Ministry of Education, Singapore - Academic Research Fund Tier 1
Grant Reference no. : 2021-T1-001-088