Weakly Supervised Gaussian Networks for Action Detection

Weakly Supervised Gaussian Networks for Action Detection
Weakly Supervised Gaussian Networks for Action Detection
Other Titles:
The IEEE Winter Conference on Applications of Computer Vision (WACV)
Publication Date:
05 March 2020
Detecting temporal extents of human actions in videos is a challenging computer vision problem that requires detailed manual supervision including frame-level labels. This expensive annotation process limits deploying action detectors to a limited number of categories. We propose a novel method, called WSGN, that learns to detect actions from weak supervision, using only video-level labels. WSGN learns to exploit both video-specific and dataset-wide statistics to predict relevance of each frame to an action category. This strategy leads to significant gains in action detection for two standard benchmarks THUMOS14 and Charades. Our method obtains excellent results compared to state-of-the-art methods that uses similar features and loss functions on THUMOS14 dataset. Similarly, our weakly supervised method is only 0.3% mAP behind a state-of-the-art supervised method on challenging Charades dataset for action localization.
License type:
Funding Info:
his research was supported by theNational Research Foundation, Singapore (Award Num-ber: NRF2015-NRF-ISF001-2451), the National ResearchFoundation Singapore under its AI Singapore Programme(Award Number: AISG-RP-2019-010), and the Agencyfor Science, Technology and Research (A*STAR) un-der its AME Programmatic Funding Scheme (Project#A18A2b0046)

Files uploaded:

File Size Format Action
wacv2020-wsgn.pdf 1.14 MB PDF Open