Pseudo channel: time embedding for motor imagery decoding

Abstract

Motor imagery　(MI) based electroencephalogram(EEG) represents a frontier in enabling direct neural control of external devices and advancing neural rehabilitation. This study introduces a novel time embedding technique, termed traveling-wave based time embedding, utilized as a pseudo channel to enhance the decoding accuracy of MI-EEG signals across various neural network architectures. Unlike traditional neural network methods that fail to account for the temporal dynamics in MI-EEG in individual difference, our approach captures time-related changes for different participants based on a priori knowledge. Through extensive experimentation with multiple participants, we demonstrate that this method not only improves classification accuracy but also exhibits greater adaptability to individual differences compared to position encoding used in Transformer architecture. Significantly, our results reveal that traveling-wave based time embedding crucially enhances decoding accuracy, particularly for participants typically considered “EEG-illiteracy”. As a novel direction in EEG research, the traveling-wave based time embedding not only offers fresh insights for neural network decoding strategies but also expands new avenues for research into attention mechanisms in neuroscience and a deeper understanding of EEG signals.

Keywords

motor imagery(MI) / pseudo channel / electroencephalogram (EEG) / neural networks

References

[1] WOLPAW J R, BIRBAUMER N, MCFARLAND D J, et al. Brain–computer interfaces for communication and control. Clinical Neurophysiology, 2002, 113(6): 767-791.

[2] PFURTSCHELLER G, NEUPER C. Motor imagery and direct brain-computer communication. Proceedings of the IEEE, 2001, 89(7): 1123-1134.

[3] PFURTSCHELLER G, BRUNNER C, SCHLOGL A, et al. Mu rhythm (de) synchronization and EEG single-trial classification of different motor imagery tasks. NeuroImage, 2006, 31(1): 153-159.

[4] HOCHBERG L R, BACHER D, JAROSIEWICZ B, et al. Reach and grasp by people with tetraplegia using a neurally controlled robotic arm. Nature, 2012, 485(7398): 372-375.

[5] LAZAROU I, NIKOLOPOULOS S, PETRANTONAKIS P C, et al. EEG-based brain-computer interfaces for communication and rehabilitation of people with motor impairment: a novel approach of the 21 st century. Frontiers in Human Neuroscience, 2018, 12. DOI:10.3389/fnhum.2018.00014.

[6] ANTONENKO P, PAAS F, GRABNER R, et al. Using electroencephalography to measure cognitive load. Educational Psychology review, 2010, 22: 425-438.

[7] CHO H, AHN M, AHN S, et al. EEG datasets for motor imagery brain–computer interface. GigaScience, 2017, 6(7): 1-8.

[8] KAYA M, BINLI M K, OZBAY E, et al. A large electroencephalographic motor imagery dataset for electroencephalographic brain computer interfaces. Scientific Data, 2018, 5(1): 180211.

[9] TANGERMANN M, K-R MULLER, AERTSEN A, et al. Review of the BCI competition IV. Frontiers in Neuroscience, 2012, 6: 5501-5513.

[10] ANG K K, CHIN Z Y, ZHANG H H, et al. Filter bank common spatial pattern (FBCSP) in brain-computer interface//2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence), June 1-8, 2008, Hong Kong, China. New York: IEEE, 2008: 2390-2397.

[11] MIAO Z Q, ZHAO M R. Weight freezing: a regularization approach for fully connected layers with an application in EEG classification. 2023: 2306.05775.

[12] SCHIRRMEISTER R T, SPRINGENBERG J T, FIEDERER L D J, et al. Deep learning with convolutional neural networks for EEG decoding and visualization. Human Brain Mapping, 2017, 38(11): 5391-5420.

[13] LAWHERN V J, SOLON A J, WAYTOWICH N R, et al. EEGNet: a compact convolutional neural network for EEG-based brain-computer interfaces. Journal of Neural Engineering, 2018, 15(5): 056013.

[14] AFLALO T, KELLIS S, KLAES C, et al. Neurophysiology. Decoding motor imagery from the posterior parietal cortex of a tetraplegic human. Science, 2015, 348(6237): 906-910.

[15] MIAO Z Q, ZHAO M R, ZHANG X, et al. LMDA-Net: a lightweight multi-dimensional attention network for general EEG-based brain-computer interfaces and interpretability. NeuroImage, 2023, 276: 120209.

[16] VASWANI A, SHAZEER N, PARMAR N, et al. Attention is all you need. Advances in Neural Information Processing Systems, 2017: 5998-6008.

[17] WU K, PENG H W, CHEN M H, et al. Rethinking and improving relative position encoding for vision transformer//2021 IEEE/CVF International Conference on Computer Vision, October 10-17, Montreal, Q C, Canada. New York: IEEE, 2021: 10013-10021.

[18] SHIV V, QUIRK C. Novel positional encodings to enable tree-based transformers//33rd Conference on Neural Information Processing Systems (NeurIPS 2019), December 9-15, 2019, Vancouver, Canada.Neural Information Processing Systems Foundation, 2019.

[19] ISLAM M A, JIA S, BRUCE N D B. How much position information do convolutional neural networks encode? 2020: 2001.08248.

[20] JEUNET C, JAHANPOUR E, LOTTE F. Why standard brain-computer interface (BCI) training protocols should be changed: an experimental study. Journal of Neural Engineering, 2016, 13(3): 036024.

[21] BCI4-2A dataset. [2024-07-21]. https://www.bbci.de/competition/iv/#dataset2a

[22] BCI4-2B dataset.[2024-07-21]. https://www.bbci.de/competition/iv/#dataset2b

[23] MIAO Z Q, ZHAO M R. Time-space-frequency feature Fusion for 3-channel motor imagery classification. Biomedical Signal Processing and Control, 2024, 90: 105867.

[24] MIAO Z Q, ZHANG X, MENON C, et al. Priming cross-session motor imagery classification with A universal deep domain adaptation framework. Neurocomputing, 2023, 556: 126659.