MetaEmotionNet: Spatial–Spectral–Temporal-Based Attention 3-D Dense Network With Meta-Learning for EEG Emotion Recognition

MetaEmotionNet: Spatial–Spectral–Temporal-Based Attention 3-D Dense Network With Meta-Learning for EEG Emotion Recognition

IEEE Transactions on Instrumentation and Measurement

10.1109/TIM.2023.3338676

https://doi.org/10.1109/tim.2023.3338676

Xiaojun Ning, Jing Wang, Youfang Lin, Xiyang Cai, Haobin Chen, Haijun Gou, Xiaoli Li, Ziyu Jia

04 December 2023

Ning, X., Wang, J., Lin, Y., Cai, X., Chen, H., Gou, H., Li, X., & Jia, Z. (2024). MetaEmotionNet: Spatial–Spectral–Temporal-Based Attention 3-D Dense Network With Meta-Learning for EEG Emotion Recognition. IEEE Transactions on Instrumentation and Measurement, 73, 1–13. https://doi.org/10.1109/tim.2023.3338676

Emotion recognition has become an important area in affective computing. Emotion recognition based on multichannel electroencephalogram (EEG) signals has gradually become popular in recent years. However, on one hand, how to make full use of different EEG features and the discriminative local patterns among the features for various emotions is challenging. Existing methods ignore the complementarity among the spatial–spectral–temporal features and discriminative local patterns in all features, which limits the classification performance. On the other hand, when dealing with cross-subject emotion recognition, existing transfer learning (TL) methods need a lot of training data. At the same time, it is extremely expensive and time-consuming to collect the labeled EEG data, which is not conducive to the wide application of emotion recognition models for new subjects. To solve the above challenges, we propose a novel spatial–spectral–temporal-based attention 3-D dense network (SST-Net) with meta-learning, named MetaEmotionNet, for emotion recognition. Specifically, MetaEmotionNet integrates the spatial–spectral–temporal features simultaneously in a unified network framework through two-stream fusion. At the same time, the 3-D attention mechanism can adaptively explore discriminative local patterns. In addition, a meta-learning algorithm is applied to reduce dependence on training data. Experiments demonstrate that the MetaEmotionNet is superior to the baseline models on two benchmark datasets.

Publisher Copyright

This research / project is supported by the National Natural Science Foundation of China - NA
Grant Reference no. : 62306317, 61603029

This research / project is supported by the China Postdoctoral Science Foundation - NA
Grant Reference no. : 2023M733738

© 2023 IEEE.  Personal use of this material is permitted.  Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works

https://oar.a-star.edu.sg/communities-collections/articles/22681

0018-9456
1557-9662

Institute for Infocomm Research