Tao, S., Goh, W. L., & Gao, Y. (2023, June 11). A Convolved Self-Attention Model for IMU-based Gait Detection and Human Activity Recognition. 2023 IEEE 5th International Conference on Artificial Intelligence Circuits and Systems (AICAS). https://doi.org/10.1109/aicas57966.2023.10168654
Abstract:
This paper presents a convolved self-attention neural network model for gait detection and human activity recognition (HAR) tasks using wearable inertial measurement unit (IMU) sensors. By embedding a convolved window inside the self-attention module, prior time step knowledge is utilized by self-attention layer to improve accuracy. Moreover, a streamlined fully connected (FC) layer without hidden layers is proposed for the feature mixer. This arrangement enables significant reduction of overall network parameters, since hidden layers occupy the majority of the parameters in a transformer encoder. Compared to the other state-of-art neural networks, the proposed method achieved better accuracy of 95.83% and 96.01% with the smallest network size on HAR datasets UCI-HAR and MHEALTH respectively,
License type:
Publisher Copyright
Funding Info:
This research / project is supported by the A*STAR - Nanosystems at the Edge (WP03)
Grant Reference no. : A18A4b0055