Xu, Y., Yang, J., Cao, H., Wu, K., Wu, M., Li, Z., & Chen, Z. (2023). Multi-Source Video Domain Adaptation with Temporal Attentive Moment Alignment Network. IEEE Transactions on Circuits and Systems for Video Technology, 1–1. https://doi.org/10.1109/tcsvt.2023.3234307
Abstract:
Multi-Source Domain Adaptation (MSDA) is a more practical domain adaptation scenario in real-world scenarios, which relaxes the assumption in conventional Unsupervised Domain Adaptation (UDA) that source data are sampled from a single domain and match a uniform data distribution. The MSDA is more challenging due to the existence of different domain shifts between distinct domain pairs. When considering videos, the negative transfer would be provoked by spatial-temporal features and can be formulated into a more challenging Multi-Source Video Domain Adaptation (MSVDA) problem. In this paper, we address the MSVDA problem by proposing a novel Temporal Attentive Moment Alignment Network (TAMAN) which aims for effective feature transfer by dynamically aligning both spatial and temporal feature moments. The TAMAN further constructs robust global temporal features by attending to dominant domain-invariant local temporal features with high local classification confidence and low disparity between global and local feature discrepancies. To facilitate future research on the MSVDA problem, we introduce comprehensive benchmarks, covering extensive MSVDA scenarios. Empirical results demonstrate a superior performance of the proposed TAMAN across multiple MSVDA benchmarks.
License type:
Publisher Copyright
Funding Info:
This research / project is supported by the A*STAR - Career Development Award
Grant Reference no. : C210112046
This research / project is supported by the Nanyang Technological University, Singapore - NTU Presidential Postdoctoral Fellowship
Grant Reference no. : NA