Multimodal CSI-Based Human Activity Recognition Using GANs

Page view(s)
Checked on Aug 26, 2023
Multimodal CSI-Based Human Activity Recognition Using GANs
Multimodal CSI-Based Human Activity Recognition Using GANs
Journal Title:
IEEE Internet of Things Journal
Publication Date:
14 May 2021
Wang, D., Yang, J., Cui, W., Xie, L., & Sun, S. (2021). Multimodal CSI-Based Human Activity Recognition Using GANs. IEEE Internet of Things Journal, 8(24), 17345–17355. doi:10.1109/jiot.2021.3080401
Channel state information (CSI)-based human activity recognition (HAR) has received great attention in recent years due to its advantages in privacy protection, insensitivity to illumination, and no requirement for wearable devices. In this article, we propose a multimodal channel state information-based activity recognition (MCBAR) system that leverages existing WiFi infrastructures and monitors human activities from CSI measurements. MCBAR aims to address the performances degradation of WiFi-based human recognition systems due to environmental dynamics. Specifically, we address the issue of nonuniformly distributed unlabeled data with rarely performed activities by taking advantages of the generative adversarial network (GAN) and semisupervised learning. We apply a multimodal generator to approximate the CSI data distribution in different environment settings with limited measured CSI data. The generated CSI data using the multimodal generator can provide better diversity for knowledge transfer. This multimodal generator improves the ability of MCBAR to recognize specific activities with various CSI patterns caused by environmental dynamics. Compared to state-of-the-art CSI-based recognition systems, MCBAR is more robust as it is able to handle the nonuniformly distributed CSI data collected from a new environment setting. In addition, diverse generated data from the multimodal generator improves the stability of the system. We have tested MCBAR under multiple experimental settings at different places. The experimental results demonstrate that our algorithm overcomes environmental dynamics and outperforms existing HAR systems.
License type:
Publisher Copyright
Funding Info:
Agency for Science, Technology and Research (Singapore) under A*STAR Graduate Scholarship (AGS)
© 2021 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works
Files uploaded:

File Size Format Action
mcbarastar.pdf 6.76 MB PDF Open